Using criteria-based interview models for assessing clinical expertise to select physiotherapists at major multisport games
Authors:
- 6 January 2015
- journal article
- research article
- Published by BMJ in British Journal of Sports Medicine
- Vol. 49 (5) , 312-317
Abstract
Background Benchmarking is an established means of identifying levels of specialist practice and competence-based interviews are a tool used to facilitate this. The London 2012 Olympic and Paralympic Games (LOCOG) provided an opportunity to introduce a pragmatic approach to assess expert behaviour in large numbers of volunteer physiotherapists. Aim To test inter-tester repeatability of an assessment matrix used to score clinical expertise in a sporting context, followed by reporting on the findings for physiotherapy selection. Methods Four volunteers were videoed answering an identical sport-specific clinical scenario. Recordings were initially scored by two experienced assessors (gold standard). Subsequently, nine assessors scored the same videos then compared with the gold standard. 602 physiotherapists were assessed during volunteer interviews for LOCOG. Scores were compared to those based on self-reported clinical experience. Cross-tabulation was used to determine levels of agreement for the initial scoring matrix and the relationship between the two scoring systems was analysed. Results Levels of agreement ranged from 22% to 88%. A good correlation (r=0.754 p>0.001) was found between self-reported clinical experience and scenario scores. Marginal data points in the correlational analysis indicated that only 52% of participants attained the same score across assessments. Conclusions A tool to facilitate assessment for large scale selection could be used for Host Nation physiotherapist selection for Major Games. There is a need to train assessors in this environment, as well as provide detailed matrices, specific to each context being assessed, to ensure that observations can be made on domain-specific and general, non-technical aspects.Keywords
This publication has 18 references indexed in Scilit:
- Expertise in performance assessment: assessors’ perspectivesAdvances in Health Sciences Education, 2012
- Contextual intelligence: overcoming hindrances to performing well in times of changeDevelopment and Learning in Organizations: An International Journal, 2011
- Prospective observational study to evaluate NOTSS (Non-Technical Skills for Surgeons) for assessing trainees' non-technical performance in the operating theatreBritish Journal of Surgery, 2011
- Effectual versus predictive logics in entrepreneurial decision-making: Differences between experts and novicesJournal of Business Venturing, 2009
- Deliberate Practice and Acquisition of Expert Performance: A General OverviewAcademic Emergency Medicine, 2008
- Quality assurance and benchmarking: an approach for European dental schoolsEuropean Journal of Dental Education, 2007
- THE PRACTICE OF COMPETENCY MODELINGPersonnel Psychology, 2000
- Identifying Competencies with Behavioral-Event InterviewsPsychological Science, 1998
- Tacit knowledge in everyday intelligent behavior.Journal of Personality and Social Psychology, 1987
- Tacit knowledge in everyday intelligent behavior.Journal of Personality and Social Psychology, 1987