Abstract
If the performance of a diagnostic imaging system is to be evaluated objectively and meaningfully, one must compare radiologists' image-based diagnoses with actual states of disease and health in a way that distinguishes between the inherent diagnostic capacity of the radiologists' interpretations of the images, and any tendencies to "under-read" or "over-read". ROC methodology provides the only known basis for distinguishing between these two aspects of diagnostic performance. After identifying the fundamental issues that motivate ROC analysis, this article develops ROC concepts in an intuitive way. The requirements of a valid ROC study and practical techniques for ROC data collection and data analysis are sketched briefly. A survey of the radiologic literature indicates the broad variety of evaluation studies in which ROC analysis has been employed.
Keywords
Medical diagnosisReceiver operating characteristicComputer scienceMedical physicsVariety (cybernetics)Artificial intelligenceRadiologyMedicineMachine learning
Affiliated Institutions
Related Publications
Assessment of radiologic tests: control of bias and other design considerations.
The assessment of new radiologic tests can be seriously hampered by the presence of systematic bias. Biases can arise from incomplete verification of the sample population; omis...
Tentative Diagnoses Facilitate the Detection of Diverse Lesions in Chest Radiographs
The influence of clinical history upon detection has been frequently studied. In a unique investigation, detection of diverse abnormalities commonly encountered in practice was ...
Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach
Methods of evaluating and comparing the performance of diagnostic tests are of increasing importance as new tests are developed and marketed. When a test is based on an observed...
Assessment of Diagnostic Technologies
A general protocol for rigorous evaluation of diagnostic systems in medicine was applied successfully in a comparative study of two radiologic techniques. Accuracies of computed...
The Effect of Verification on the Assessment of Imaging Techniques
In order to measure the accuracy of a diagnostic imaging technique, the correctness of each observer decision must be determined. This is often difficult in clinical cases, and ...
Publication Info
- Year
- 1986
- Type
- review
- Volume
- 21
- Issue
- 9
- Pages
- 720-733
- Citations
- 1632
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1632
OpenAlex
Cite This
Charles E. Metz
(1986).
ROC Methodology in Radiologic Imaging.
Investigative Radiology
, 21
(9)
, 720-733.
https://doi.org/10.1097/00004424-198609000-00009
Identifiers
- DOI
- 10.1097/00004424-198609000-00009