Abstract
Receiver operating characteristic (ROC) methodology has been increasingly used in medical applications in the last 10 years. The text by Swets and Pickett has popularized the technique and the journal Medical Decision Making (1981--) provides a forum for further methodologic issues. In this article, I will (1) describe the nature of the data generated by ROC studies; (2) evaluate the choices of summary indices of performance (accuracy); (3) outline the data-analytic techniques used, and how to incorporate data from multiple observers and multiple "readings"; (4) review proposed alternatives to the commonly used binormal ROC model; and (5) discuss issues, such as verification bias, and challenges, such as multicenter comparative imaging studies and the difficulty of obtaining "truth data", which need to be addressed when adapting ROC methods to medical contexts.
Keywords
Receiver operating characteristicMedicineMedical physicsArtificial intelligenceComputer scienceMachine learning
Affiliated Institutions
Related Publications
A method of comparing the areas under receiver operating characteristic curves derived from the same cases.
Receiver operating characteristic (ROC) curves are used to describe and compare the performance of diagnostic technology and diagnostic algorithms. This paper refines the statis...
Receiver Operator characteristic (ROC) Analysis without Truth
Receiver operator characteristic (ROC) analysis, the preferred method of evaluating diag nostic imaging tests, requires an independent assessment of the true state of disease, w...
The fuzzy receiver operating characteristic function and medical decisions with uncertainty
Receiver operating characteristic (ROC) methodology is an important tool in decision making where there are two outcomes. By introducing the notion of partial degree of membersh...
Receiver operating characteristic laboratory (ROCLAB): Software for developing decision strategies that account for uncertainty
Receiver operating characteristic (ROC) methodology evaluates how well a decision strategy classifies retrospective dichotomous or fuzzy events. It also provides a rational basi...
ROC Methodology in Radiologic Imaging
If the performance of a diagnostic imaging system is to be evaluated objectively and meaningfully, one must compare radiologists' image-based diagnoses with actual states of dis...
Publication Info
- Year
- 1989
- Type
- article
- Volume
- 29
- Issue
- 3
- Pages
- 307-35
- Citations
- 689
- Access
- Closed
External Links
Citation Metrics
689
OpenAlex
Cite This
James A. Hanley
(1989).
Receiver operating characteristic (ROC) methodology: the state of the art..
PubMed
, 29
(3)
, 307-35.