Correspondence of motivational interviewing adherence and competence ratings in real and role-played client sessions.
Authors:
- Suzanne E. DeckerSDSuzanne E. Decker
- Kathleen M. CarrollKCKathleen M. Carroll
- Charla NichCNCharla Nich
- Monica Canning-BallMCMonica Canning-Ball
- Steve MartinoSMSteve Martino
- 1 March 2013
- journal article
- research article
- Published by American Psychological Association (APA) in Psychological Assessment
- Vol. 25 (1) , 306-312
Abstract
Treatment integrity ratings (adherence and competence) are frequently used as outcome measures in clinician training studies, drawn from recorded real client or role-played client sessions. However, it is unknown whether clinician adherence and competence are similar in real client and role-played sessions or whether real and role-play clients provide similar opportunities for skill demonstration. In this study, we examined the correspondence of treatment adherence and competence ratings obtained in real client and role-played sessions for 91 clinicians trained in motivational interviewing (MI), using data from a multisite trial examining 3 methods of clinician training (Martino et al., 2011). Results indicated overall poor integrity rating correspondence across the 2 session types, as indicated by weak correlations (rs=.05-.27). Clinicians were rated significantly more MI adherent overall and specifically used more advanced MI strategies in role-played than real client sessions at several assessment time points (ds=0.36, 0.42). Real clients, in comparison to the role-play actor, demonstrated greater motivation at the beginning of the session (d=1.09), discussion of unrelated topics (d=0.70), and alliance with the clinician (d=0.72). These findings suggest that MI integrity rating data obtained from real client and role-played sessions may not be interchangeable. More research is needed to improve the procedures and psychometric strength of treatment integrity assessment based on role-played sessions.Keywords
Funding Information
- Department of Veterans Affairs
- Veterans Affairs Connecticut Healthcare System
- National Institute on Drug Abuse (R01 DA16970, DA023230, U10-DA013038, P50-DA09241)
This publication has 17 references indexed in Scilit:
- The dissemination and implementation of evidence-based psychological treatments: A review of current efforts.American Psychologist, 2010
- The alliance in motivational enhancement therapy and counseling as usual for substance use problems.Journal of Consulting and Clinical Psychology, 2009
- Community program therapist adherence and competence in motivational enhancement therapyDrug and Alcohol Dependence, 2008
- Site matters: Multisite randomized trial of motivational enhancement therapy in community drug abuse clinics.Journal of Consulting and Clinical Psychology, 2007
- Motivational interviewing to improve treatment engagement and outcome in individuals seeking treatment for substance abuse: A multisite effectiveness studyDrug and Alcohol Dependence, 2006
- We Don't Train in Vain: A Dissemination Trial of Three Strategies of Training Clinicians in Cognitive-Behavioral Therapy.Journal of Consulting and Clinical Psychology, 2005
- A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.Journal of Consulting and Clinical Psychology, 2004
- An evaluation of workshop training in motivational interviewing for addiction and mental health cliniciansDrug and Alcohol Dependence, 2004
- A general system for evaluating therapist adherence and competence in psychotherapy research in the addictionsDrug and Alcohol Dependence, 2000
- High agreement but low kappa: II. Resolving the paradoxesJournal of Clinical Epidemiology, 1990