Verification & Validation


Verification Testing

Below are the completed verification studies.


  1. Comfortability
  • Design Input Addressed: The device must be comfortable for the patient.
  • Verification Activity: Material hardness test on the urine collection cup. (Shore A Hardness of 30 ± 1.0)
  • Acceptance Criteria: ≥ 90% accuracy → PASS
  • Statistical Analysis: Run two, one sample t-tests for each position on the cup, and compare to 30 ± 1.0 with a confidence interval of 95%.
Verification results for Design Input 1.
  1. Volume Verification
    • Design Input Addressed: The device must collect an acceptable urine sample volume.
    • Verification Activity: Run first peristaltic pump to collect a volume ≥ 2.0 mL.
    • Acceptance Criteria: Collected volume ≥ 2.0 mL with 95% accuracy → PASS
  • Statistical Analysis: Run one sample t-test, compare to 10 mL necessary to complete testing where α = 0.05 and a C.I. of 95%.
N10
Average14.78 ± 0.249
P-value<0.0001
Pass/FailPass
Verification results for Design Input 2.
  1. Biomarker Detection Accuracy
  • Design Input Addressed: The device must be able to detect the presence of bioburden associated with UTIs.
  • Verification Activity: Using prepared urine samples with known nitrite and leukocyte concentrations, a colorimetric sensor measures dye intensity resulting from the Griess reaction (nitrites) and a two-step chemical reaction (leukocyte esterase), with sensor readings compared to spectrophotometer results.
  • Acceptance Criteria: ≥ 95% accuracy across trials → PASS
    • Statistical Analysis: Run McNemar’s test based on the varying concentrations, compare to α = 0.01.
    N15
    P-value1.0
    Accuracy40%
    Pass/FailFail
    Verification testing results for Nitrites for Design Input 3.
    N15
    P-value0.014
    Accuracy60%
    Pass/FailFail
    Verification testing results for Leukocytes for Design Input 3.

      1. Electrical Safety
      • Design Input Addressed: The device must meet electrical safety standards IEC 60601-1.
      • Verification Activity: Run the device and measure leakage current using a digital multimeter to confirm compliance with IEC 60601-1 standards.
      • Acceptance Criteria: ≤ 500 μA → PASS
      • Statistical Analysis: Run one sample t-test, compare to 500 μA where α = 0.05 and a C.I. of 95%.
      N10
      Average24 ± 5.16 μA
      P-value<0.0001
      Pass/FailPass
      Verification testing results for Design Input 6.
      1. Sanitization Effectiveness
      • Design Input Addressed: The device must be sanitizable.
      • Verification Activity: Run a cleaning sequence after a positive sample, then test with a negative sample to confirm no residual contamination.
      • Acceptance Criteria: ≥ 95% accuracy across trials → PASS
      • Statistical Analysis: Run McNemar’s test based on two possible outcomes: Positive or Negative, compare to α = 0.05.
      N20
      P-value0.0117
      Accuracy95%
      Pass/FailPass
      Verification testing results for Design Input 7.

      Validation Testing

      Below are the completed validation studies.


      1. Comfortability
      • Design Input Addressed: The device must be comfortable for the patient.
      • Validation Activity: Survey a group of subjects to test for comfortability based on a 1-5 scale.
      • Statistical Analysis: A non-parametric sign test was conducted to assess whether the subjects’ responses were significantly greater than the acceptance score of a 3 with a C.I. of 95%.
      Comfort with cup flushed to skinComfort with silicone in handsComfort with touching genitals
      N202020
      Average4.25 ± 0.555.00 ± 0.004.00 ± 0.65
      P-value< 0.0001< 0.0001< 0.0001
      Pass/FailPassPassPass
      Validation results for Design Input 1.
      1. Volume Validation
      • Design Input Addressed: The device must collect an acceptable urine sample volume.
      • Validation Activity: Run a sample collection experiment with the load cell and pump with 95% sample collection accuracy.
      • Statistical Analysis: Run one sample t-test, compare to 5 mL necessary to complete reach testing where α = 0.05 and a C.I. of 95%.
      Load Cell 1Load Cell 2
      N1010
      Average5.24± 0.195.19± 0.19
      P-value0.016760.01174
      Pass/FailPassPass
      Validation results for Design Input 2.
      1. Biomarker Detection Accuracy
      • Design Input Addressed: The device must be able to detect the presence of bioburden associated with UTIs.
      • Validation Activity: Run urinalysis test with positive and negative samples with 95% accuracy.
      • Statistical Analysis: Run McNemar’s test based on two possible outcomes: Positive or Negative, compare to α = 0.01.
      N20
      P-value1
      Accuracy70%
      Pass/FailFail
      Validation testing results for Nitrites for Design Input 3.
      N20
      P-value0.0832
      Accuracy85%
      Pass/FailFail
      Validation testing results for Leukocytes for Design Input 3.
      1. Communication of Results
      • Design Input Addressed: The device must communicate the levels of bioburden detected in the urine sample.
      • Validation Activity: Create positive, caution, and negative samples to test if the results displayed correlate with the level of bacteria detected.
      • Statistical Analysis: Run Chi-Square test based on three possible outcomes: Positive, Caution, and Negative, compare to α = 0.01.
      N20
      P-value<0.001
      Accuracy80%
      Pass/FailFail
      Validation testing results for Design Input 4.
      1. Timing
      • Design Input Addressed: The device must be able to provide results in a clinically relevant amount of time.
      • Validation Activity: Run full testing sequence and time it.
      • Statistical Analysis: Run one sample t-test, compared to 900 seconds (15 minutes) where
        α = 0.05 and a C.I. of 95%.
      N20
      Average183.7± 1.49
      P-value<0.0001
      Pass/FailPass
      Validation testing results for Design Input 5.
      1. Waste Disposal
      • Design Input Addressed: The device must be sanitizable.
      • Validation Activity: Survey subjects on observed cleaning sequence and subsequent trial run on a scale of 1-5.
      • Statistical Analysis: A non-parametric sign test was conducted to assess whether the subjects’ responses were significantly greater than the acceptance score of a 4 with a C.I. of 99%.
      Disposure ProcedureSecond Sample EffectCross Contamination
      N202020
      Average4.70 ± 0.554.75 ± 0.444.60 ± 0.50
      P-value<0.0001< 0.0001< 0.0001
      Pass/FailPassPassPass
      Validation testing results for Design Input 7.