Abstract
Items such as physical exam findings, radiographic interpretations, or other diagnostic tests often rely on some degree of subjective interpretation by observers. Studies that measure the agreement between two or more observers should include a statistic that takes into account the fact that observers will sometimes agree or disagree simply by chance. The kappa statistic (or kappa coefficient) is the most commonly used statistic for this purpose. A kappa of 1 indicates perfect agreement, whereas a kappa of 0 indicates agreement equivalent to chance. A limitation of kappa is that it is affected by the prevalence of the finding under observation. Methods to overcome this limitation have been described.
Keywords
Cohen's kappaKappaStatisticAgreementStatisticsInterpretation (philosophy)Measure (data warehouse)MathematicsComputer scienceData mining
Affiliated Institutions
Related Publications
Interobserver Variation in Interpreting Chest Radiographs for the Diagnosis of Acute Respiratory Distress Syndrome
To measure the reliability of chest radiographic diagnosis of acute respiratory distress syndrome (ARDS) we conducted an observer agreement study in which two of eight intensivi...
Interobserver agreement for the diagnosis of transient ischemic attacks.
The interobserver agreement for the diagnosis of a cerebral transient ischemic attack (TIA) was investigated in a pool of eight senior and interested neurologists from the same ...
The Measurement of Observer Agreement for Categorical Data
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially invo...
Interrater reliability: the kappa statistic.
The kappa statistic is frequently used to test interrater reliability. The importance of rater reliability lies in the fact that it represents the extent to which the data colle...
Diagnosis of transient ischemic attacks: improvement of interobserver agreement by a check-list in ordinary language.
To try and improve the interobserver agreement for the diagnosis of TIA, we used a checklist in which the symptoms were recorded in plain language, instead of in abstract diagno...
Publication Info
- Year
- 2005
- Type
- article
- Volume
- 37
- Issue
- 5
- Pages
- 360-3
- Citations
- 7055
- Access
- Closed
External Links
Citation Metrics
7055
OpenAlex
Cite This
Anthony J. Viera,
Joanne M. Garrett
(2005).
Understanding interobserver agreement: the kappa statistic..
PubMed
, 37
(5)
, 360-3.