Skip to main content

Table 2 Summary validity measures of information on receipt of screening in survey self-report and IHIE (Weighted)

From: Comparison of health information exchange data with self-report in measuring cancer screening

 

Survey responses (SR) (1)

EMR = No (2)

EMR = Yes (3)

Sensitivity (95% CI)

\(\frac{True\;positive}{True\;positive+False\;negative}\)  

(4)

Specificity (95% CI)

\(\frac{True\;negative}{False\;positive+True\;negative}\)  

(5)

Concordance- Gwet’s AC (95% CI)

Benchmark scale for reliability

(6)

Screening Tests

 Colonoscopy

SR = No

SR = Yes

45/505(8.91)

115/505(22.77)

39/505(7.72)

305/505(60.39)

\(\frac{305}{305+39}=0.88\) (0.85,0.92)

\(\frac{45}{115+45}=0.28\) (0.21,0.35)

0.52a

(0.44,0.59)

Moderate

 FIT test

SR = No

SR = Yes

371/504(73.61)

19/504(3.77)

98/504(19.44)

15/504(2.98)

\(\frac{15}{15+98}=0.13\) (0.07,0.21)

\(\frac{371}{19+371}=0.95\) (0.93,0.97)

0.69a

(0.63,0.75)

Substantial

 HPV test

SR = No

SR = Yes

64/161(39.75)

20/161(12.42)

43/161(26.71)

33/161(20.49)

\(\frac{33}{33+43}=0.43\) (0.32,0.55)

\(\frac{64}{20+64}=0.76\) (0.66,0.85)

0.24a

(0.08,0.40)

Fair

 PAP test

SR = No

SR = Yes

22/185(11.89)

35/185(18.92)

24/185(12.97)

103/185(55.67)

\(\frac{103}{103+34}=0.81\) (0.73,0.88)

\(\frac{22}{35+22}=0.39\) (0.26,0.52)

0.46a

(0.33,0.60)

Moderate

 Mammogram

SR = No

SR = Yes

14/255(5.49)

26/255(10.19)

24/255(9.41)

190/255(74.51)

\(\frac{190}{190+24}=0.89\) (0.84,0.93)

\(\frac{14}{26+14}=0.35\) (0.21,0.52)

0.73a

(0.65,0.81)

Substantial

  1. Results in columns 2 and 3 are listed as marginal totals and are statistically significant at 1% level of significance. Study sample is restricted to 711 out of 970 patients (73.3%) completing the survey, who provided HIPAA authorization, allowing access to their electronic health information. Gwet’s probabilistic benchmarking method according to the Landis and Koch scale of reliability is: -1.0–0.0 (Poor), 0.0–0.2 (Slight), 0.2–0.4 (Fair), 0.4–0.6 (Moderate), 0.6–0.8 (Substantial), 0.8–1.0 (Almost Perfect) [23]. The measures in all the columns are adjusted for sampling weights
  2. Abbreviations: SR Self-report, EMR Electronic Medical Records, FIT Fecal immunochemical test, HPV Human Papillomavirus, CI Confidence Interval, AC Agreement Coefficient
  3. adenotes significance at 1% level
  4. bdenotes significance at 5% level
  5. cdenotes significance at 10% level