Choosing the best index for the average score intraclass correlation coefficient
Author:
- 17 July 2015
- journal article
- Published by Springer Nature in Behavior Research Methods
- Vol. 48 (3) , 994-1003
Abstract
The intraclass correlation coefficient (ICC)(2) index from a one-way random effects model is widely used to describe the reliability of mean ratings in behavioral, educational, and psychological research. Despite its apparent utility, the essential property of ICC(2) as a point estimator of the average score intraclass correlation coefficient is seldom mentioned. This article considers several potential measures and compares their performance with ICC(2). Analytical derivations and numerical examinations are presented to assess the bias and mean square error of the alternative estimators. The results suggest that more advantageous indices can be recommended over ICC(2) for their theoretical implication and computational ease.Keywords
This publication has 21 references indexed in Scilit:
- Effect size estimates: Current use, calculations, and interpretation.Journal of Experimental Psychology: General, 2012
- On effect size.Psychological Methods, 2012
- Effect Size Reporting Practices in Published ArticlesEducational and Psychological Measurement, 2008
- Intraclass Correlation Values for Planning Group-Randomized Trials in EducationEducational Evaluation and Policy Analysis, 2007
- Pivotal estimation with applications for the intraclass correlation coefficient in the balanced one-way random effects modelJournal of Statistical Planning and Inference, 2000
- Group Size, ICC Values, and Group-Level Correlations: A SimulationOrganizational Research Methods, 1998
- Group Size and Measures of Group-Level Properties: An Examination of Eta-Squared and ICC ValuesJournal of Management, 1998
- A Note on the Unbiased Estimation of the Intraclass CorrelationPsychometrika, 1990
- A Review of Inference Procedures for the Intraclass Correlation Coefficient in the One-Way Random Effects ModelInternational Statistical Review, 1986
- On various intraclass correlation reliability coefficients.Psychological Bulletin, 1976