On Misconceptions and the Limited Usefulness of Ordinal Alpha
- 21 September 2017
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 78 (6) , 1056-1071
Abstract
This article discusses the theoretical and practical contributions of Zumbo, Gadermann, and Zeisser’s family of ordinal reliability statistics. Implications, interpretation, recommendations, and practical applications regarding their ordinal measures, particularly ordinal alpha, are discussed. General misconceptions relating to this family of ordinal reliability statistics are highlighted, and arguments for interpreting ordinal alpha as a measure of hypothetical reliability, as opposed to observed reliability, are presented. It is concluded that ordinal alpha should not be used in routine reliability analyses and reports, and instead should be understood as hypothetical tool, similar to the Spearman–Brown prophecy formula, for theoretically increasing the number of ordinal categorical response options in future applied testing applications.Keywords
This publication has 24 references indexed in Scilit:
- Old and New Ideas for Data Screening and Assumption Testing for Exploratory and Confirmatory Factor AnalysisFrontiers in Psychology, 2012
- The Impact of Outliers on Cronbach’s Coefficient Alpha Estimate of Reliability: Ordinal/Rating Scale Item ResponsesEducational and Psychological Measurement, 2009
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- Alpha, Dimension-Free, and Model-Based Internal Consistency ReliabilityPsychometrika, 2008
- An Empirical Evaluation of Alternative Methods of Estimation for Confirmatory Factor Analysis With Ordinal Data.Psychological Methods, 2004
- On the practice of dichotomization of quantitative variables.Psychological Methods, 2002
- Classical Test Theory in Historical PerspectiveEducational Measurement: Issues and Practice, 1997
- Analysis of correlation matrices using covariance structure models.Psychological Bulletin, 1989
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951
- On the Theory of Scales of MeasurementScience, 1946