The reliability of multidimensional neuropsychological measures: from alpha to omega
Top Cited Papers
- 21 April 2017
- journal article
- research article
- Published by Taylor & Francis in The Clinical Neuropsychologist
- Vol. 31 (6-7) , 1113-1126
Abstract
Objective: To demonstrate that Coefficient omega, a model-based estimate, is more a more appropriate index of reliability than coefficient alpha for the multidimensional scales that are commonly employed by neuropsychologists. Method: As an illustration, a structural model of an overarching general factor and four first-order factors for the WAIS-IV based on the standardization sample of 2200 participants was identified and omega coefficients were subsequently computed for WAIS-IV composite scores. Results: Alpha coefficients were ≥ .90 and omega coefficients ranged from .75 to .88 for WAIS-IV factor index scores, indicating that the blend of general and group factor variance in each index score created a reliable multidimensional composite. However, the amalgam of variance from general and group factors did not allow the precision of Full Scale IQ (FSIQ) and factor index scores to be disentangled. In contrast, omega hierarchical coefficients were low for all four factor index scores (.10–.41), indicating that most of the reliable variance of each factor index score was due to the general intelligence factor. In contrast, the omega hierarchical coefficient for the FSIQ score was .84. Conclusions: Meaningful interpretation of WAIS-IV factor index scores as unambiguous indicators of group factors is imprecise, thereby fostering unreliable identification of neurocognitive strengths and weaknesses, whereas the WAIS-IV FSIQ score can be interpreted as a reliable measure of general intelligence. It was concluded that neuropsychologists should base their clinical decisions on reliable scores as indexed by coefficient omega.Keywords
This publication has 67 references indexed in Scilit:
- A Tutorial on Interpreting Bifactor Model ScoresInternational Journal of Testing, 2013
- Evaluating the performance of different procedures for constructing confidence intervals for coefficient alpha: A simulation studyBritish Journal of Mathematical and Statistical Psychology, 2012
- Some supplementary methods for the analysis of WAIS‐IV index scores in neuropsychological assessmentJournal of Neuropsychology, 2011
- Discrepancy Score Reliabilities in the WAIS-IV Standardization SampleJournal of Psychoeducational Assessment, 2009
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- Learning disabilities: The need for neuropsychological evaluationArchives of Clinical Neuropsychology, 2008
- Ethical Principles of Psychologists and Code of Conduct.American Psychologist, 2002
- Meaning of Reliability in Terms of Correct and Incorrect Clinical Decisions: The Art of Decision Making is Still AliveJournal of Clinical and Experimental Neuropsychology, 2001
- Limitations of Coefficient Alpha as an Index of Test Unidimensionality1Educational and Psychological Measurement, 1977
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951