Abstract
This paper gives a method of estimating the reliability of a test which has been divided into three parts. The parts do not have to satisfy any statistical criteria like parallelism or τ -equivalence. If the parts are homogeneous in content (congeneric), i.e. , if their true scores are linearly related and if sample size is large then the method described in this paper will give the precise value of the reliability parameter. If the homogeneity condition is violated then underestimation will typically result. However, the estimate will always be at least as accurate as coefficient α and Guttman's lower bound λ 3 when the same data are used. An application to real data is presented by way of illustration. Seven different splits of the same test are analyzed. The new method yields remarkably stable reliability estimates across splits as predicted by the theory. One deviating value can be accounted for by a certain unsuspected peculiarity of the test composition. Both coefficient α and λ 3 would not have led to the same discovery.
Keywords
Guttman scaleHomogeneity (statistics)MathematicsStatisticsEquivalence (formal languages)Reliability (semiconductor)Sample size determinationVariance (accounting)Applied mathematicsDiscrete mathematics
Affiliated Institutions
Related Publications
Coefficient Alpha and the Internal Structure of Tests
A general formula ( α ) of which a special case is the Kuder-Richardson coefficient of equivalence is shown to be the mean of all split-half coefficients resulting from differen...
Stopping Rules in Principal Components Analysis: A Comparison of Heuristical and Statistical Approaches
Approaches to determining the number of components to interpret from principal components analysis were compared. Heuristic procedures included: retaining components with eigenv...
Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
This article examines the adequacy of the "rules of thumb" conventional cutoff criteria and several new alternatives for various fit indexes used to evaluate model fit in practi...
A study of the power associated with testing factor mean differences under violations of factorial invariance
We examine the power associated with the test of factor mean differences when the assumption of factorial invariance is violated. Utilizing the Wald test for obtaining power, is...
Regression and time series model selection in small samples
A bias correction to the Akaike information criterion, AIC, is derived for regression and autoregressive time series models. The correction is of particular use when the sample ...
Publication Info
- Year
- 1974
- Type
- article
- Volume
- 39
- Issue
- 4
- Pages
- 491-499
- Citations
- 54
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
54
OpenAlex
Cite This
Walter Kristof
(1974).
Estimation of Reliability and True Score Variance from a Split of a Test into Three Arbitrary Parts.
Psychometrika
, 39
(4)
, 491-499.
https://doi.org/10.1007/bf02291670
Identifiers
- DOI
- 10.1007/bf02291670