Impact of a Competency-Based Mechanical Ventilation Course Using Virtual Simulation
Open Access
- 18 February 2025
- journal article
- Published by Oxford University Press (OUP) in ATS Scholar
- Vol. 6 (2) , 202-216
Abstract
Background: Mechanical ventilation (MV) skills are crucial for clinicians who care for critically ill patients; however, few training programs incorporate structured curricula and appropriate assessments. The use of virtual simulators for teaching and assessments has not been evaluated and can offer advantages. Objective: To create an MV competency-based course for internal medicine residents using a virtual simulator and to evaluate course impact. Methods: We developed an online, 8 month, competency-based MV course for internal medicine residents, including virtual simulation. Each module included a 1-hour session (20 min of lecture, 40 min of virtual simulation) and self-directed learning material. Engagement was reinforced through live meetings, an online platform, and group chats. To evaluate competency, we adapted a validated simulation-based assessment to a virtual MV simulator (virtual simulation-based assessment [SBA]). Course impact was evaluated using the four-level Kirkpatrick model, including surveys for satisfaction and confidence (level 1), knowledge assessment with a multiple-choice examination (level 2), and deliberate practice with the simulator and clinical competence on the virtual SBA (level 3). Results: Eighty-one residents out of 103 completed the course and rated it as effective, with a net promoter score of 9.2. The use of virtual simulation was rated as very useful by most participants. Confidence in caring for patients under MV in different scenarios before and after the course significantly increased. On a 10-point scale, the multiple-choice examination score increased 1.19 points (95% confidence interval, 0.91–1.47; P < 0.001) from baseline to the end of the course, and the virtual SBA score at the end of the course was 6.15 ± 1.26 for post-graduate year 1 residents and 6.48 ± 1.56 for post-graduate year 2 residents (P = 0.33). Performance on different competencies varied, with lower scores on tasks such as asynchrony correction. Ninety-nine percent of residents reported a very positive (58%) or positive (41%) impact of the course in their practice. Conclusion: We developed a satisfactory and effective MV course including virtual simulation for internal medicine residents during the COVID-19 pandemic. Confidence and knowledge increased by the end of the course, although performance on complex MV skills was suboptimal. The use of virtual simulators for teaching and assessment are valuable new tools for teaching MV.Keywords
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil
- Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil
- Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq
This publication has 44 references indexed in Scilit:
- Differences in Resident Self-Evaluation and Clinical Competency Committee Evaluation Using ACGME Milestone Versions 1.0 and 2.0Journal of Surgical Education, 2023
- Mechanical Ventilation Education for AllChest, 2021
- The REDCap consortium: Building an international community of software platform partnersJournal of Biomedical Informatics, 2019
- Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 CountriesJAMA, 2016
- Epidemiological trends in invasive mechanical ventilation in the United States: A population-based studyJournal of Critical Care, 2015
- Emergency Medicine Residents' Knowledge of Mechanical VentilationThe Journal of Emergency Medicine, 2015
- Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: A randomized trialJournal of Critical Care, 2012
- The epidemiology of acute respiratory failure in hospitalized patients: A Brazilian prospective cohort studyJournal of Critical Care, 2011
- Seven keys to unlock the four levels of evaluationPerformance Improvement Journal, 2006
- Current and Projected Workforce Requirements for Care of the Critically Ill and Patients With Pulmonary DiseaseCan We Meet the Requirements of an Aging Population?JAMA, 2000