What too strict a method obscures about the validity of outcome measures
- 4 February 2021
- journal article
- research article
- Published by Taylor & Francis in Psychotherapy Research
- Vol. 31 (7) , 882-894
Abstract
Objective: To assess the outcome of psychotherapeutic treatments, psychotherapy researchers often compare pre- and post-treatment scores on self-report outcome measures. In this paper, the common assumption is challenged that pre-to-post decreasing and increasing outcome scores are indicative of successful and failed therapies, respectively. Method: The outcome of 29 psychotherapeutic treatments was evaluated by means of quantitative analysis of pre- and post-treatment scores on commonly used outcome measures (such as the Symptom Checklist-90-R, the Inventory of Interpersonal Problems, and the General Health Questionnaire-12), as well as through consensual qualitative research. Results: Overall, a moderate to low convergence between qualitative and quantitative evaluations of outcome was observed. Detailed analyses of six cases are presented in which pre-to-post comparisons of outcome measures proved misleading. Conclusions: It is concluded that psychotherapy outcome research might benefit from assessment strategies that are sensitive to the singularities of individual treatments and to the complexity of the phenomenon of therapeutic outcome. Furthermore, classical psychometric evaluations of the validity of outcome measures might be supplemented with less-systematic evaluations that take any contingent source of information on outcome into account.Keywords
This publication has 33 references indexed in Scilit:
- The end of the primary outcome measure: A research agenda for constructing its replacementClinical Psychology Review, 2011
- Understanding how and why psychotherapy leads to changePsychotherapy Research, 2009
- The Attack of the PsychometriciansPsychometrika, 2006
- Evidence-based practice in psychology.American Psychologist, 2006
- Normal Science, Pathological Science and PsychometricsTheory & Psychology, 2000
- Between Numbers and NotionsTheory & Psychology, 1999
- Quality of life: Expanding the scope of clinical significance.Journal of Consulting and Clinical Psychology, 1999
- Self-reports: How the questions shape the answers.American Psychologist, 1999
- A cautionary note on measurement error corrections in structural equation models.Psychological Methods, 1998
- ber den anschaulichen Inhalt der quantentheoretischen Kinematik und MechanikThe European Physical Journal A, 1927