Patient Simulation: A Literary Synthesis of Assessment Tools in Anesthesiology
Authors:
Open Access
- 20 December 2009
- journal article
- Published by Korea Health Personnel Licensing Examination Institute in Journal of Educational Evaluation for Health Professions
- Vol. 6 (3) , 3
Abstract
High-fidelity patient simulation (HFPS) has been hypothesized as a modality for assessing competency of knowledge and skill in patient simulation, but uniform methods for HFPS performance assessment (PA) have not yet been completely achieved. Anesthesiology as a field founded the HFPS discipline and also leads in its PA. This project reviews the types, quality, and designated purpose of HFPS PA tools in anesthesiology. We used the systematic review method and systematically reviewed anesthesiology literature referenced in PubMed to assess the quality and reliability of available PA tools in HFPS. Of 412 articles identified, 50 met our inclusion criteria. Seventy seven percent of studies have been published since 2000; more recent studies demonstrated higher quality. Investigators reported a variety of test construction and validation methods. The most commonly reported test construction methods included ?占퐉odified Delphi Techniques??for item selection, reliability measurement using inter-rater agreement, and intra-class correlations between test items or subtests. Modern test theory, in particular generalizability theory, was used in nine (18%) of studies. Test score validity has been addressed in multiple investigations and shown a significant improvement in reporting accuracy. However the assessment of predicative has been low across the majority of studies. Usability and practicality of testing occasions and tools was only anecdotally reported. To more completely comply with the gold standards for PA design, both shared experience of experts and recognition of test construction standards, including reliability and validity measurements, instrument piloting, rater training, and explicit identification of the purpose and proposed use of the assessment tool, are required.Keywords
This publication has 63 references indexed in Scilit:
- Part Task and Variable Priority Training in First-year Anesthesia Resident EducationAnesthesiology, 2008
- Setting Performance Standards for Mannequin-Based Acute-Care ScenariosSimulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 2008
- Anaesthetists' management of oxygen pipeline failure: room for improvement*Anaesthesia, 2007
- Applying theory to practice in undergraduate education using high fidelity simulationMedical Teacher, 2006
- Psychometric characteristics of simulation‐based assessment in anaesthesia and accuracy of self‐assessed scores*Anaesthesia, 2005
- The Use of a Human Patient Simulator in the Evaluation of and Development of a Remedial Prescription for an Anesthesiologist with Lapsed Medical SkillsAnesthesia & Analgesia, 2002
- Evaluation of medical studentsʼ performances using the anesthesia simulatorAcademic Medicine, 1999
- Testing Internal Consistency and Construct Validity During Evaluation of Performance in a Patient SimulatorAnesthesia & Analgesia, 1998
- A systematic approach to conducting a non-statistical meta-analysis of research literatureAcademic Medicine, 1995
- Construct validity in psychological tests.Psychological Bulletin, 1955