Conceptualising and classifying validity evidence for simulation
- 20 October 2009
- journal article
- Published by Wiley in Medical Education
- Vol. 43 (11) , 1028-1035
Abstract
Context The term ‘validity’ is used pervasively in medical education, especially as it relates to curriculum, assessment, measurement and instrumentation. Exactly what is meant by the term ‘validity’ in the medical education literature is not always clearly defined. Objectives This study attempts to clarify, conceptualise and classify how validity fits within the context of assessment and to provide a framework for medical educators to determine the type and degree of validity evidence required for their specific assessment and evaluation needs. Methods We apply a structure for considering validity, and its association with validation, in medical education. We build this discussion around the use of simulation in medical training because of its rapid growth as a foundation for numeric measurement of performance in the development of clinical skills and reasoning. We explain why validity is inextricably tied to the assessment process in both simulation‐based medical training and traditional medical education. Results This logical framework structures the type and degree of validity evidence for various assessment and evaluation needs. We also provide an example for medical educators to reference and follow in collecting and reviewing their own needs for validity evidence in all aspects of medical education. Conclusions Assessment is integral to measurement and decision making in medical education. The implications of assessment results are variably dependent on the inferences and decisions made from them. As such, validity evidence is critical, but is also flexibly tied to those decisions and not all assessments require the same degree of validity rigor. The framework described herein reinforces a model for medical educators to use in developing their assessment and evaluation needs and associated requirements for validity evidence.Keywords
This publication has 7 references indexed in Scilit:
- Certification pass rate of 100% for fundamentals of laparoscopic surgery skills after proficiency-based trainingSurgical Endoscopy, 2008
- Validity of the MISTELS Simulator for Laparoscopy Training in UrologyJournal of Endourology, 2005
- Validity threats: overcoming interference with proposed interpretations of assessment dataMedical Education, 2004
- Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgerySurgery, 2004
- Validity: on the meaningful interpretation of assessment dataMedical Education, 2003
- Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.American Psychologist, 1995
- The Assessment of Professional CompetenceEvaluation & the Health Professions, 1992