CASPer, an online pre-interview screen for personal/professional characteristics: prediction of national licensure scores
Authors:
- 21 November 2016
- journal article
- research article
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 22 (2) , 327-336
Abstract
Typically, only a minority of applicants to health professional training are invited to interview. However, pre-interview measures of cognitive skills predict for national licensure scores (Gauer et al. in Med Educ Online 21 2016) and subsequently licensure scores predict for performance in practice (Tamblyn et al. in JAMA 288(23): 3019–3026, 2002; Tamblyn et al. in JAMA 298(9):993–1001, 2007). Assessment of personal and professional characteristics, with the same psychometric rigour of measures of cognitive abilities, are needed upstream in the selection to health profession training programs. To fill that need, Computer-based Assessment for Sampling Personal characteristics (CASPer)—an on-line, video-based screening test—was created. In this paper, we examine the correlation between CASPer and Canadian national licensure examination outcomes in 109 doctors who took CASPer at the time of selection to medical school. Specifically, CASPer scores were correlated against performance on cognitive and ‘non-cognitive’ subsections of both the Medical Council of Canada Qualifying Examination (MCCQE) Parts I (end of medical school) and Part II (18 months into specialty training). Unlike most national licensure exams, MCCQE has specific subcomponents examining personal/professional qualities, providing a unique opportunity for comparison. The results demonstrated moderate predictive validity of CASPer to national licensure outcomes of personal/professional characteristics three to six years after admission to medical school. These types of disattenuated correlations (r = 0.3–0.5) are not otherwise predicted by traditional screening measures. These data support the ability of a computer-based strategy to screen applicants in a feasible, reliable test, which has now demonstrated predictive validity, lending evidence of its validation for medical school applicant selection.Keywords
Funding Information
- National Board of Medical Examiners
- Medical Research Council Canada (CA)
This publication has 32 references indexed in Scilit:
- Do MCAT scores predict USMLE scores? An analysis on 5 years of medical student dataMedical Education Online, 2016
- A contemporary approach to validity arguments: a practical guide to K ane's frameworkMedical Education, 2015
- Multiple mini interviews for undergraduate physiotherapy entry in the United Kingdom (UK)Physiotherapy, 2015
- Multiple mini‐interview test characteristics: ‘tis better to ask candidates to recall than to imagineMedical Education, 2014
- Association Between a Medical School Admission Process Using the Multiple Mini-interview and National Licensing Examination ScoresJAMA, 2012
- Rater and occasion impacts on the reliability of pre‐admission assessmentsMedical Education, 2009
- Extending the Interview to All Medical School Candidates—Computer-Based Multiple Sample Evaluation of Noncognitive Skills (CMSENS)Academic Medicine, 2009
- Predictive validity of the multiple mini‐interview for selecting medical traineesMedical Education, 2009
- The CanMEDS initiative: implementing an outcomes-based framework of physician competenciesMedical Teacher, 2007
- Shifting ParadigmsAcademic Medicine, 2002