Abstract
Investigators examining empirically derived classifications are often concerned with the replicability of an obtained classification. However, most available statistics which allow replication comparison suffer from various limitations. This paper proposes an adjustment to one of these statistics, the Rand statistic, which will allow comparison across different levels for number of clusters found within a classification. This adjustment permits the user to compare several different classifications with respect to classification agreement, while correcting for the contribution of chance to any observed agreement.
Keywords
StatisticAgreementStatisticsReplication (statistics)Cohen's kappaSummary statisticsEconometricsPsychologyComputer scienceMathematics
Affiliated Institutions
Related Publications
Understanding interobserver agreement: the kappa statistic.
Items such as physical exam findings, radiographic interpretations, or other diagnostic tests often rely on some degree of subjective interpretation by observers. Studies that m...
Interrater reliability: the kappa statistic.
The kappa statistic is frequently used to test interrater reliability. The importance of rater reliability lies in the fact that it represents the extent to which the data colle...
Agreement between physicians on assessment of outcome following severe head injury
✓ This study describes inter-observer agreement between physicians and consistency of one observer on repeated scoring in the assessment of outcome 6 to 12 months after severe h...
Interobserver agreement for the assessment of handicap in stroke patients.
Interobserver agreement for the assessment of handicap in stroke patients was investigated in a group of 10 senior neurologists and 24 residents from two centers. One hundred pa...
Matching Models in the Analysis of Cross-Classifications
Inference models motivated by the combinatorial chance literature and the concept of object matching may be used in the analysis of a contingency table if the conditional assump...
Publication Info
- Year
- 1984
- Type
- article
- Volume
- 44
- Issue
- 1
- Pages
- 33-37
- Citations
- 156
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
156
OpenAlex
Cite This
Leslie C. Morey,
Alan Agresti
(1984).
The Measurement of Classification Agreement: An Adjustment to the Rand Statistic for Chance Agreement.
Educational and Psychological Measurement
, 44
(1)
, 33-37.
https://doi.org/10.1177/0013164484441003
Identifiers
- DOI
- 10.1177/0013164484441003