Abstract
To determine why many diagnostic tests have proved to be valueless after optimistic introduction into medical practice, we reviewed a series of investigations and identified two major problems that can cause erroneous statistical results for the "sensitivity" and "specificity" indexes of diagnostic efficacy. Unless an appropriately broad spectrum is chosen for the diseased and nondiseased patients who comprise the study population, the diagnostic test may receive falsely high values for its "rule-in" and "rule-out" performances. Unless the interpretation of the test and the establishment of the true diagnosis are done independently, bias may falsely elevate the test's efficacy. Avoidance of these problems might have prevented the early optimism and subsequent disillusionment with the diagnostic value of two selected examples: the carcinoembryonic antigen and nitro-blue tetrazolium tests.
Keywords
Affiliated Institutions
Related Publications
Assessment of radiologic tests: control of bias and other design considerations.
The assessment of new radiologic tests can be seriously hampered by the presence of systematic bias. Biases can arise from incomplete verification of the sample population; omis...
Epidemiology: Reflections on Testing the Validity of Psychiatric Interviews
Laboratory tests that validate psychiatric disorder are unavailable. Accordingly, the validity of structured diagnostic interviews such as the Diagnostic Interview Schedule have...
The Measurement of Observer Agreement for Categorical Data
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially invo...
Measuring the Accuracy of Diagnostic Systems
Diagnostic systems of several kinds are used to distinguish between two classes of events, essentially "signals" and "noise." For them, analysis in terms of the "relative operat...
Test-Retest Reliability of the Diagnostic Interview Schedule for Children (DISC 2.1)
Test-retest reliability findings were consistent with or superior to those reported in previous studies. Results support the usefulness of the DISC in further clinical and epide...
Publication Info
- Year
- 1978
- Type
- article
- Volume
- 299
- Issue
- 17
- Pages
- 926-930
- Citations
- 1700
- Access
- Closed
External Links
Social Impact
Social media, news, blog, policy document mentions
Citation Metrics
Cite This
Identifiers
- DOI
- 10.1056/nejm197810262991705