Deriving Reliable Change Statistics from Test-Retest Normative Data: Comparison of Models and Mathematical Expressions
Open Access
- 2 March 2010
- journal article
- research article
- Published by Oxford University Press (OUP) in Archives of Clinical Neuropsychology
- Vol. 25 (3) , 244-256
Abstract
The use of reliable change (RC) statistics to determine whether an individual has significantly improved or deteriorated on retesting is growing rapidly in clinical neuropsychology. This paper demonstrates how with only basic test–retest data and a series of simple expressions, the clinician/researcher can implement the majority of contemporary RC model(s). Though sharing a fundamental structure, RC models vary in how they derive predicted retest scores and standard error terms. Published test–retest normative data and a simple case study are presented to demonstrate how to calculate several well-known RC scores. The paper highlights the circumstances under which models will diverge in the estimation of RC. Most importantly variations in individual's performance relative to controls at initial testing, practice effects, inequality of control variability from test to retest, and degree of reliability will see systematic and predictable disagreement among models. More generally, the limitations and opportunities of RC methodology were discussed. Although a consensus on preferred model continues to be debated, the comparison of RC models in clinical samples is encouraged.Keywords
This publication has 29 references indexed in Scilit:
- Comparing patients' predicted test scores from a regression equation with their obtained scores: A significance test and point estimate of abnormality with accompanying confidence limits.Neuropsychology, 2006
- The Relationship between Two Methods of Evaluating an Examinee's Difference ScoresJournal of Psychoeducational Assessment, 2000
- Reliable Change formula queryJournal of the International Neuropsychological Society, 2000
- Reliable Change formula query: A statistician's commentsJournal of the International Neuropsychological Society, 2000
- Practice Effects on Commonly Used Measures of Executive Function Across Twelve MonthsThe Clinical Neuropsychologist, 1999
- Regression Equations in Clinical Neuropsychology: An Evaluation of Statistical Methods for Comparing Predicted and Obtained ScoresJournal of Clinical and Experimental Neuropsychology, 1998
- Empirical Techniques for Determining the Reliability, Magnitude, and Pattern of Neuropsychological Change After Epilepsy SurgeryEpilepsia, 1996
- Revisiting the Standard Errors of Measurement, Estimate, and Prediction and Their Application to Test ScoresPerceptual and Motor Skills, 1996
- Individual change after epilepsy surgery: Practice effects and base-rate information.Neuropsychology, 1993
- The use of risk factors in medical diagnosis: Opportunities and cautionsJournal of Clinical Epidemiology, 1990