Recognize the Value of the Sum Score, Psychometrics’ Greatest Accomplishment
Top Cited Papers
Open Access
- 1 March 2024
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 89 (1) , 84-117
Abstract
The sum score on a psychological test is, and should continue to be, a tool central in psychometric practice. This position runs counter to several psychometricians’ belief that the sum score represents a pre-scientific conception that must be abandoned from psychometrics in favor of latent variables. First, we reiterate that the sum score stochastically orders the latent variable in a wide variety of much-used item response models. In fact, item response theory provides a mathematically based justification for the ordinal use of the sum score. Second, because discussions about the sum score often involve its reliability and estimation methods as well, we show that, based on very general assumptions, classical test theory provides a family of lower bounds several of which are close to the true reliability under reasonable conditions. Finally, we argue that eventually sum scores derive their value from the degree to which they enable predicting practically relevant events and behaviors. None of our discussion is meant to discredit modern measurement models; they have their own merits unattainable for classical test theory, but the latter model provides impressive contributions to psychometrics based on very few assumptions that seem to have become obscured in the past few decades. Their generality and practical usefulness add to the accomplishments of more recent approaches.Keywords
This publication has 91 references indexed in Scilit:
- From alpha to omega: A practical solution to the pervasive problem of internal consistency estimationBritish Journal of Psychology, 2013
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- A note on monotone likelihood ratio of the total score variable in unidimensional item response theoryBritish Journal of Mathematical and Statistical Psychology, 2008
- A dynamical model of general intelligence: The positive manifold of intelligence by mutualism.Psychological Review, 2006
- An index to quantify an individual's scientific research outputProceedings of the National Academy of Sciences, 2005
- The Concept of Validity.Psychological Review, 2004
- Coefficient Alpha and the Reliability of Composite MeasurementsPsychometrika, 1967
- Variation of the Standard Error of MeasurementPsychometrika, 1949
- Variation in Test Validity with Variation in the Distribution of Item Difficulties, Number of Items, and Degree of their IntercorrelationPsychometrika, 1946
- A Basis for Analyzing Test-Retest ReliabilityPsychometrika, 1945