Removing very low-performing therapists: A simulation of performance-based retention in psychotherapy.
Open Access
- 1 September 2015
- journal article
- research article
- Published by American Psychological Association (APA) in Psychotherapy
- Vol. 52 (3) , 329-336
Abstract
Therapists can impact the likelihood a given patient will benefit from psychotherapy. However, therapists are rarely held accountable for their patients' outcomes. As a result, low-performing providers likely continue to practice alongside providers with high response rates. In the current study, we conducted a Monte Carlo simulation to illustrate a thought experiment-what happens to patient outcomes if therapists with the worst outcomes were removed from practice? We drew initial samples of 50 therapists from 3 simulated populations of 1,000 therapists with a mean patient response rate of 50% and different effect sizes for therapist variability in outcomes. We simulated 30 patient outcomes for each therapist, with outcome defined as response to treatment versus no response. We removed therapists with response rates in the bottom 5% and replaced them with a random sample of therapists from the population. Over 10 years, the difference in responses between the lowest and highest performing therapists was substantial (between 697 and 997 additional responses to treatment). After repeatedly removing the lowest performing providers 40 times (simulating a 10-year time span), response rates increased substantially. The cumulative number of patient responses (i.e., summing the total number of responses across 10 years) increased by 4,266, 6,404, and 9,307 when therapists accounted for 5%, 10%, or 20% of the patient outcome variance, respectively. These findings indicate that performance-based retention of therapists could improve the quality of psychotherapy in health systems by improving the average response rate and decreasing the probability that a patient will be treated by a therapist who consistently has poor outcomes.Keywords
Funding Information
- National Institutes of Health (R34/DA034860)
- National Institute on Alcohol Abuse and Alcoholism (R01/AA018673)
This publication has 24 references indexed in Scilit:
- Expertise in psychotherapy: An elusive goal?American Psychologist, 2014
- Effect of Pay-for-Performance Incentives on Quality of Care in Small Practices With Electronic Health RecordsJAMA, 2013
- Patient-rated alliance as a measure of therapist performance in two clinical settings.Journal of Consulting and Clinical Psychology, 2013
- Effect of Nonpayment for Preventable Infections in U.S. HospitalsNew England Journal of Medicine, 2012
- The Long-Term Effect of Premier Pay for Performance on Patient OutcomesNew England Journal of Medicine, 2012
- Intraclass Correlation Associated with Therapists: Estimates and Applications in Planning Psychotherapy ResearchCognitive Behaviour Therapy, 2011
- Effectiveness of workshop training for psychosocial addiction treatments: A systematic reviewJournal of Substance Abuse Treatment, 2005
- Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care.Journal of Consulting and Clinical Psychology, 2005
- The Empirical Status of Empirically Supported Psychotherapies: Assumptions, Findings, and Reporting in Controlled Clinical Trials.Psychological Bulletin, 2004
- A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation.Psychological Bulletin, 1999