Abstract
A procedure for estimating the reliability of sets of ratings in terms of the intraclass correlation coefficient is discussed. The procedure is based upon the analysis of variance and the estimation of variance components. For the one-way classification the intraclass correlation coefficient defined as the ratio of variances can be interpreted as a correlation coefficient. Caution, however, is urged in the application of the definition to a two-way model, i.e., one in which between-rater variance is removed. It is maintained that the frequent use of the standard definition of the one-way intraclass correlation coefficient applied to the two-way classification is not a proper procedure if in fact the coefficient is to be interpreted as a correlation coefficient. Definitions for reliability obtained from the two-way models are given which can legitimately be considered correlation coefficients.
Keywords
Intraclass correlationCorrelation ratioFisher transformationCorrelation coefficientVariance (accounting)Reliability (semiconductor)StatisticsInterclass correlationCorrelationMeasure (data warehouse)Pearson product-moment correlation coefficientCoefficient of variationMathematicsComputer sciencePsychometricsData miningThermodynamicsPhysics
Related Publications
On various intraclass correlation reliability coefficients.
Bartko (1966, 1974) has presented some analysis of variance (ANOVA) intraclass correlation reliability coefficients that avoid some serious deficiencies not uncommonly found in ...
Approximate Interval Estimation for a Certain Intraclass Correlation Coefficient
When the raters participating in a reliability study are a random sample from a larger population of raters, inferences about the intraclass correlation coefficient must be base...
Thirteen Ways to Look at the Correlation Coefficient
Abstract In 1885, Sir Francis Galton first defined the term "regression" and completed the theory of bivariate correlation. A decade later, Karl Pearson developed the index that...
A Generalized Family of Coefficients of Relational Agreement for Numerical Scales
A family of coefficients of relational agreement for numerical scales is proposed. The theory is a generalization to multiple judges of the Zegers and ten Berge theory of associ...
Correlation Coefficients: Appropriate Use and Interpretation
Correlation in the broadest sense is a measure of an association between variables. In correlated data, the change in the magnitude of 1 variable is associated with a change in ...
Publication Info
- Year
- 1966
- Type
- article
- Volume
- 19
- Issue
- 1
- Pages
- 3-11
- Citations
- 2285
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
2285
OpenAlex
Cite This
John J. Bartko
(1966).
The Intraclass Correlation Coefficient as a Measure of Reliability.
Psychological Reports
, 19
(1)
, 3-11.
https://doi.org/10.2466/pr0.1966.19.1.3
Identifiers
- DOI
- 10.2466/pr0.1966.19.1.3