Putting the Patient Back in Clinical Significance: Moderated Nonlinear Factor Analysis for Estimating Clinically Significant Change in Treatment for Posttraumatic Stress Disorder
- 11 November 2020
- journal article
- research article
- Published by Wiley in Journal of Traumatic Stress
- Vol. 34 (2) , 454-466
Abstract
The present study introduced a modernized approach to Jacobson and Truax's (1991) methods of estimating treatment effects on individual‐level (a) movement from the clinical to the normative range and (b) reliable change on posttraumatic stress disorder (PTSD) severity. Participants were 450 trauma‐exposed women (M age = 39.2 years, SD = 8.9, range: 18–65 years) who presented to seven geographically diverse community mental health and substance use treatment centers. Data from 53 of these women, none of whom met the criteria for full or subthreshold PTSD, were used to establish the normative range. Using moderated nonlinear factor analysis (MNLFA) scale scoring, which weights symptoms by their clinical relevance, a significantly larger proportion of participants moved into the normative range for PTSD severity scores and/or exhibited reliable changes after treatment compared to the same individuals’ movement when using symptom counts. Further, approximately 24% of the participants showed discrepant judgments on reliable change indices (RCI) between MNLFA scores and symptom counts, likely due to the false assumption that the standard error of measurement is equal for all levels of underlying PTSD severity when estimating RCIs with symptom counts. An MNLFA approach to estimating underlying PTSD severity can provide clinically meaningful information about individual‐level change without the de facto assumption that PTSD symptoms have equivalent weight. Study implications are discussed with regard to a joint emphasis on (a) measurement models that highlight differential symptom weighting and (b) treatment‐arm differences in individual‐level outcomes rather than the current overemphasis of treatment‐arm differences on group‐averaged trajectories.Keywords
Funding Information
- National Institute on Alcohol Abuse and Alcoholism (R01AA025853)
This publication has 32 references indexed in Scilit:
- Attendance and substance use outcomes for the Seeking Safety program: Sometimes less is more.Journal of Consulting and Clinical Psychology, 2012
- The role of alcohol misuse in PTSD outcomes for women in community treatment: A secondary analysis of NIDA's Women and Trauma StudyDrug and Alcohol Dependence, 2010
- Confidence intervals for effect sizes: Compliance and clinical significance in the Journal of Consulting and Clinical Psychology..Journal of Consulting and Clinical Psychology, 2010
- Reformulating PTSD forDSM‐V: Life after Criterion AJournal of Traumatic Stress, 2009
- Multisite randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders.Journal of Consulting and Clinical Psychology, 2009
- Using Item Response Theory to assess the Flynn Effect in the National Longitudinal Study of Youth 79 Children and Young Adults dataIntelligence, 2008
- Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis.Developmental Psychology, 2008
- Dissemination and Feasibility of a Cognitive-Behavioral Treatment for Substance Use Disorders and Posttraumatic Stress Disorder in the Veterans AdministrationJournal of Psychoactive Drugs, 2006
- Evidence-based practice in psychology.American Psychologist, 2006
- A Test for Symmetry in Contingency TablesJournal of the American Statistical Association, 1948