A behaviour‐based coding tool for assessing supervisors' adherence and competence: Findings from a motivational interviewing implementation study
Open Access
- 29 June 2022
- journal article
- research article
- Published by Wiley in Clinical Psychology & Psychotherapy
- Vol. 29 (6) , 1942-1949
Abstract
Supervision seems to be an essential part of therapist training and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behaviour-two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by 10 supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (alpha = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors and performing quality assurance of supervision, is to create instruments that can measure these behaviours. This study is a step in that direction.Keywords
This publication has 55 references indexed in Scilit:
- Evidence-Based Training for Clinical Supervisors: A Systematic Review of 11 Controlled StudiesThe Clinical Supervisor, 2011
- The assessment of professional competence: building blocks for theory developmentBest Practice & Research Clinical Obstetrics & Gynaecology, 2010
- Bridging the Science and Practice of Clinical Supervision: Some Discoveries, Some MisconceptionsThe Clinical Supervisor, 2010
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- A Step Forward in Teaching Addiction Counselors How to Supervise Motivational Interviewing Using a Clinical Trials Training ApproachJournal of Teaching in the Addictions, 2008
- Editorial – Checklists vs. Ratings, the Illusion of Objectivity, the Demise of Skills and the Debasement of EvidenceAdvances in Health Sciences Education, 2005
- Assessing professional competence: from methods to programmesMedical Education, 2005
- Assessing competence in the use of motivational interviewingJournal of Substance Abuse Treatment, 2005
- Teacher's PETS: a new observational measure of experiential training interactionsClinical Psychology & Psychotherapy, 2002
- Clinical Supervision in Four Mental Health Professions: A Review of the EvidenceBehaviour Change, 2001