Abstract
A common mistake in analysis of cluster randomized trials is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects. This article gives a simple correction to the t statistic that would be computed if clustering were (incorrectly) ignored. The correction is a multiplicative factor depending on the total sample size, the cluster size, and the intraclass correlation ρ. The corrected t statistic has Student’s t distribution with reduced degrees of freedom. The corrected statistic reduces to the t statistic computed by ignoring clustering when ρ = 0. It reduces to the t statistic computed using cluster means when ρ = 1. If 0 < ρ < 1, it lies between these two, and the degrees of freedom are in between those corresponding to these two extremes.
Keywords
Cluster analysisStatisticsComputer scienceTest (biology)Statistical hypothesis testingEconometricsMathematics
Related Publications
Regression and time series model selection in small samples
A bias correction to the Akaike information criterion, AIC, is derived for regression and autoregressive time series models. The correction is of particular use when the sample ...
Cluster-Sample Methods in Applied Econometrics
Inference methods that recognize the clustering of individual observations have been available for more than 25 years. Brent Moulton (1990) caught the attention of economists wh...
Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments
The problem of identifying differentially expressed genes in designed microarray experiments is considered. Lonnstedt and Speed (2002) derived an expression for the posterior od...
A study of the power associated with testing factor mean differences under violations of factorial invariance
We examine the power associated with the test of factor mean differences when the assumption of factorial invariance is violated. Utilizing the Wald test for obtaining power, is...
Cosmological implications of baryon acoustic oscillation measurements
Here, we derive constraints on cosmological parameters and tests of dark energy models from the combination of baryon acoustic oscillation (BAO) measurements with cosmic microwa...
Publication Info
- Year
- 2007
- Type
- article
- Volume
- 32
- Issue
- 2
- Pages
- 151-179
- Citations
- 114
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
114
OpenAlex
Cite This
Larry V. Hedges
(2007).
Correcting a Significance Test for Clustering.
Journal of Educational and Behavioral Statistics
, 32
(2)
, 151-179.
https://doi.org/10.3102/1076998606298040
Identifiers
- DOI
- 10.3102/1076998606298040