Quang Ngo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Quang Ngo has a total of 55 co-authors. Here are the top co-authors by number of shared publications:
- Elif Bilgic
McMaster University
2 shared publications - Keyna Bracken
Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Canada
2 shared publications - Matthew Sibbald
McMaster University
2 shared publications Ram N. Singh
Department of Pediatric Critical Care Medicine, Children's Hospital, London Health Sciences Centre, University of Western Ontario, 800 Commissioners Road East, P.O. Box 5010, London, ON, Canada N6A 5W9
2 shared publications- Teresa M. Chan
School of Medicine, Toronto Metropolitan University, Toronto, Canada
2 shared publications Adrianna Ranger
1 shared publication
Latest Publications
- 3 December 2025
- Published by Elsevier in Canadian Journal of Ophthalmology
- Vol. 61 (3) , 625-628
Development of a new competency-based comprehensive training program for vision screeners
- 3 December 2025
- Published by Elsevier in Canadian Journal of Ophthalmology
- Vol. 61 (3) , 625-628
Development of a new competency-based comprehensive training program for vision screeners
- Open Access
- 23 July 2025
- Published by Wiley in AEM Education and Training
- Vol. 9 (4) , e70083
Simulation Platforms to Train and Assess Pediatric Acute Care Procedural Skills: A Scoping Review
Background: Medical trainees have limited opportunities to practice certain pediatric emergency medicine (PEM) procedures in the clinical setting. Simulation‐based education provides an opportunity for trainees to improve their technical and non‐technical skills. This scoping review aimed to explore the ways in which simulation has been used to train and assess medical learners.Methods: A search was conducted from 2011 to August 2022 using MEDLINE, OVID Embase, OVID Emcare, and Cochrane Trials, among others. The review included empirical studies that used simulation for training medical trainees in four essential pediatric procedures: intubation, lumbar puncture, intraosseous insertion, and chest tube insertion. Six reviewers independently screened titles, abstracts, and full texts. Data were recorded, stored, and summarized in a standardized spreadsheet.Results: The search retrieved 4073 articles, of which 207 underwent full‐text screening. Data were extracted from 107 studies. Among these, 69 studies focused exclusively on intubation skills, 19 studies on lumbar puncture, 10 studies on intraosseous insertion, and two studies on chest tube insertion. The majority of studies (n = 61) involved residents, while 15 studies focused on medical students. Training platforms included mannequins (n = 84), ex‐vivo models (n = 6), task trainers (n = 4), and standardized patients (n = 1). Competency was largely assessed using an assessment tool (n = 45) as the sole assessment method.Conclusions: Simulation‐based training and assessment can support medical learners in developing key technical and non‐technical skills related to PEM procedures. However, there is a need for diversification of simulation platforms used, expansion of procedures targeted in simulation‐based training and assessment programs, and creation of standardized and procedure‐specific assessments.
- 23 July 2025
- Published by Wiley in AEM Education and Training
- Vol. 9 (4) , e70083
Open AccessSimulation Platforms to Train and Assess Pediatric Acute Care Procedural Skills: A Scoping Review
Background: Medical trainees have limited opportunities to practice certain pediatric emergency medicine (PEM) procedures in the clinical setting. Simulation‐based education provides an opportunity for trainees to improve their technical and non‐technical skills. This scoping review aimed to explore the ways in which simulation has been used to train and assess medical learners.Methods: A search was conducted from 2011 to August 2022 using MEDLINE, OVID Embase, OVID Emcare, and Cochrane Trials, among others. The review included empirical studies that used simulation for training medical trainees in four essential pediatric procedures: intubation, lumbar puncture, intraosseous insertion, and chest tube insertion. Six reviewers independently screened titles, abstracts, and full texts. Data were recorded, stored, and summarized in a standardized spreadsheet.Results: The search retrieved 4073 articles, of which 207 underwent full‐text screening. Data were extracted from 107 studies. Among these, 69 studies focused exclusively on intubation skills, 19 studies on lumbar puncture, 10 studies on intraosseous insertion, and two studies on chest tube insertion. The majority of studies (n = 61) involved residents, while 15 studies focused on medical students. Training platforms included mannequins (n = 84), ex‐vivo models (n = 6), task trainers (n = 4), and standardized patients (n = 1). Competency was largely assessed using an assessment tool (n = 45) as the sole assessment method.Conclusions: Simulation‐based training and assessment can support medical learners in developing key technical and non‐technical skills related to PEM procedures. However, there is a need for diversification of simulation platforms used, expansion of procedures targeted in simulation‐based training and assessment programs, and creation of standardized and procedure‐specific assessments.
- 4 December 2024
- Published by Springer Nature in Medical Science Educator
- Vol. 35 (1) , 351-358
The Predictive Power of Short Answer Questions in Undergraduate Medical Education Progress Difficulty
Background To better understand the link between formative assessments and progress difficulty, we conducted an analysis in the undergraduate MD program of the Michael G. DeGroote School of Medicine by comparing formative assessment scores on Short Answer Questions (SAQ) called Concept Application Exercises (CAE) with subsequent progress difficulty. CAE scores are designed to formatively assess knowledge translation. These scores are not formally incorporated into the progress decision at the end of each curricular unit, which is holistic in nature. Students are referred to a student progress remediation committee if they fail to meet the curricular objectives. We sought to investigate the following research question: Do short answer questions, in the form of CAEs, predict subsequent learner progress difficulty? Methods Data from the last four student cohorts of 2022–2025 were included. To address the predictive power of CAE score characteristics, a binary logistic regression model was constructed with remediation committee referral as the dependent variable and CAE score characteristics as the independent variable. Results This study found that the average CAE score is the most powerful predictor of later progress difficulty, with each point drop in average score associated with a 37% increase in the odds of referral to the remediation committee. Conclusion These findings illustrate the predictive value of the SAQ to identify later progress difficulty.
- 4 December 2024
- Published by Springer Nature in Medical Science Educator
- Vol. 35 (1) , 351-358
The Predictive Power of Short Answer Questions in Undergraduate Medical Education Progress Difficulty
Background To better understand the link between formative assessments and progress difficulty, we conducted an analysis in the undergraduate MD program of the Michael G. DeGroote School of Medicine by comparing formative assessment scores on Short Answer Questions (SAQ) called Concept Application Exercises (CAE) with subsequent progress difficulty. CAE scores are designed to formatively assess knowledge translation. These scores are not formally incorporated into the progress decision at the end of each curricular unit, which is holistic in nature. Students are referred to a student progress remediation committee if they fail to meet the curricular objectives. We sought to investigate the following research question: Do short answer questions, in the form of CAEs, predict subsequent learner progress difficulty? Methods Data from the last four student cohorts of 2022–2025 were included. To address the predictive power of CAE score characteristics, a binary logistic regression model was constructed with remediation committee referral as the dependent variable and CAE score characteristics as the independent variable. Results This study found that the average CAE score is the most powerful predictor of later progress difficulty, with each point drop in average score associated with a 37% increase in the odds of referral to the remediation committee. Conclusion These findings illustrate the predictive value of the SAQ to identify later progress difficulty.
- Open Access
- 19 January 2024
- Published by MDPI AG in International Medical Education
- Vol. 3 (1) , 32-43
Examining the Efficacy of ChatGPT in Marking Short-Answer Assessments in an Undergraduate Medical Program
Traditional approaches to marking short-answer questions face limitations in timeliness, scalability, inter-rater reliability, and faculty time costs. Harnessing generative artificial intelligence (AI) to address some of these shortcomings is attractive. This study aims to validate the use of ChatGPT for evaluating short-answer assessments in an undergraduate medical program. Ten questions from the pre-clerkship medical curriculum were randomly chosen, and for each, six previously marked student answers were collected. These sixty answers were evaluated by ChatGPT in July 2023 under four conditions: with both a rubric and standard, with only a standard, with only a rubric, and with neither. ChatGPT displayed good Spearman correlations with a single human assessor (r = 0.6–0.7, p < 0.001) across all conditions, with the absence of a standard or rubric yielding the best correlation. Scoring differences were common (65–80%), but score adjustments of more than one point were less frequent (20–38%). Notably, the absence of a rubric resulted in systematically higher scores (p < 0.001, partial η2 = 0.33). Our findings demonstrate that ChatGPT is a viable, though imperfect, assistant to human assessment, performing comparably to a single expert assessor. This study serves as a foundation for future research on AI-based assessment techniques with potential for further optimization and increased reliability.
- 19 January 2024
- Published by MDPI AG in International Medical Education
- Vol. 3 (1) , 32-43
Open AccessExamining the Efficacy of ChatGPT in Marking Short-Answer Assessments in an Undergraduate Medical Program
Traditional approaches to marking short-answer questions face limitations in timeliness, scalability, inter-rater reliability, and faculty time costs. Harnessing generative artificial intelligence (AI) to address some of these shortcomings is attractive. This study aims to validate the use of ChatGPT for evaluating short-answer assessments in an undergraduate medical program. Ten questions from the pre-clerkship medical curriculum were randomly chosen, and for each, six previously marked student answers were collected. These sixty answers were evaluated by ChatGPT in July 2023 under four conditions: with both a rubric and standard, with only a standard, with only a rubric, and with neither. ChatGPT displayed good Spearman correlations with a single human assessor (r = 0.6–0.7, p < 0.001) across all conditions, with the absence of a standard or rubric yielding the best correlation. Scoring differences were common (65–80%), but score adjustments of more than one point were less frequent (20–38%). Notably, the absence of a rubric resulted in systematically higher scores (p < 0.001, partial η2 = 0.33). Our findings demonstrate that ChatGPT is a viable, though imperfect, assistant to human assessment, performing comparably to a single expert assessor. This study serves as a foundation for future research on AI-based assessment techniques with potential for further optimization and increased reliability.
- Open Access
- 1 September 2023
- Published by Oxford University Press (OUP) in Paediatrics & Child Health
- Vol. 28 (Supplement) , e38
81 A Snapshot of Entrustability of Acute Care Procedural Skills in Paediatrics Residents
General paediatricians are expected to be competent in the resuscitation of children and important to this competency is the ability to perform certain acute care procedural skills. Paediatric residents are expected to be competent in these procedural skills by the end of their training as specified by the Royal College (RCPSC). However, the extent to which residents are actually competent is not fully assessed or understood. There are currently no evidence-supported guidelines suggesting the best path toward procedural skills competency for residents, and they are less likely to receive formal training and or supervision for completing procedural skills than their nursing counterparts. They also report feeling inadequately prepared. To address this gap, the Paediatrics program at McMaster University aimed to conduct a longitudinal cross-sectional study examining the competency of their trainees in specific acute care procedures. The purpose of this first study was to present a cross-sectional observation of the entrustability of paediatric residents in 6 procedural skills. The procedures were bag-valve mask (BVM) ventilation, intubation, intraosseous (IO) line insertion, chest tube insertion, and cardiopulmonary resuscitation (CPR), and defibrillation, which are all requirements of the RCPSC. Paediatric residents attended an “Acute Care Procedure Day” where they performed each procedure with direct observation and feedback. Entrustable professional activity (EPA) scores (from 1 to 5) were recorded for each attempt. Prior, a 1-hour interactive lecture was given that included procedural information and a video demonstration of each procedure. Residents received a copy of the milestones per EPA. Demographic information, self-perceived comfort, and EPA data were collected. Descriptive statistics and Pearson correlation for PGY level versus EPA scores were performed. Of the 36 residents who participated, 24(67%) were in postgraduate year (PGY) 1-2, and 12 PGY 3-4(33%). Reported levels of past experience were lowest for placement of chest tubes (n=3, 8.3%), followed by IOs (n=19, 52.8%). During the sessions, residents showed the highest levels of initial entrustment with IO placement (EPA 4-5 in 28/33), BVM skills (EPA 4-5 in 27/33), and CPR (EPA 4-5 in 16/25), and lowest for chest tube placement (EPA 4-5 in 0/35), defibrillation (EPA 4-5 in 5/31 residents) and intubation (EPA 4-5 in 17/31). Despite this, self-reported overall confidence after training for these procedures was moderate to high. There was strong correlation between PGY level and EPA score for intubation, and no correlation for the other procedures. Our findings show that entrustability of certain acute care skills is not being obtained (i.e., defibrillation, chest tube placement), and that there were large discrepancies between entrustment scores and perceived comfort among the PGY levels. Further research is needed to characterize the learning curves for these skills, and their relative importance in paediatrics training.
- 1 September 2023
- Published by Oxford University Press (OUP) in Paediatrics & Child Health
- Vol. 28 (Supplement) , e38
Open Access81 A Snapshot of Entrustability of Acute Care Procedural Skills in Paediatrics Residents
General paediatricians are expected to be competent in the resuscitation of children and important to this competency is the ability to perform certain acute care procedural skills. Paediatric residents are expected to be competent in these procedural skills by the end of their training as specified by the Royal College (RCPSC). However, the extent to which residents are actually competent is not fully assessed or understood. There are currently no evidence-supported guidelines suggesting the best path toward procedural skills competency for residents, and they are less likely to receive formal training and or supervision for completing procedural skills than their nursing counterparts. They also report feeling inadequately prepared. To address this gap, the Paediatrics program at McMaster University aimed to conduct a longitudinal cross-sectional study examining the competency of their trainees in specific acute care procedures. The purpose of this first study was to present a cross-sectional observation of the entrustability of paediatric residents in 6 procedural skills. The procedures were bag-valve mask (BVM) ventilation, intubation, intraosseous (IO) line insertion, chest tube insertion, and cardiopulmonary resuscitation (CPR), and defibrillation, which are all requirements of the RCPSC. Paediatric residents attended an “Acute Care Procedure Day” where they performed each procedure with direct observation and feedback. Entrustable professional activity (EPA) scores (from 1 to 5) were recorded for each attempt. Prior, a 1-hour interactive lecture was given that included procedural information and a video demonstration of each procedure. Residents received a copy of the milestones per EPA. Demographic information, self-perceived comfort, and EPA data were collected. Descriptive statistics and Pearson correlation for PGY level versus EPA scores were performed. Of the 36 residents who participated, 24(67%) were in postgraduate year (PGY) 1-2, and 12 PGY 3-4(33%). Reported levels of past experience were lowest for placement of chest tubes (n=3, 8.3%), followed by IOs (n=19, 52.8%). During the sessions, residents showed the highest levels of initial entrustment with IO placement (EPA 4-5 in 28/33), BVM skills (EPA 4-5 in 27/33), and CPR (EPA 4-5 in 16/25), and lowest for chest tube placement (EPA 4-5 in 0/35), defibrillation (EPA 4-5 in 5/31 residents) and intubation (EPA 4-5 in 17/31). Despite this, self-reported overall confidence after training for these procedures was moderate to high. There was strong correlation between PGY level and EPA score for intubation, and no correlation for the other procedures. Our findings show that entrustability of certain acute care skills is not being obtained (i.e., defibrillation, chest tube placement), and that there were large discrepancies between entrustment scores and perceived comfort among the PGY levels. Further research is needed to characterize the learning curves for these skills, and their relative importance in paediatrics training.
- 6 June 2023
- Published by Oxford University Press (OUP) in Paediatrics & Child Health
- Vol. 28 (4) , 229-234
Prevalence and characterization of food insecurity in a Canadian paediatric emergency department
Objectives: Food insecurity (FI) is associated with a number of adverse child health outcomes and increased emergency department (ED) use. The COVID-19 pandemic exacerbated the financial hardship faced by many families. We sought to determine the prevalence of FI among children with ED visits, compare this to pre-pandemic rates, and describe associated risk factors. Methods: From September to December 2021, families presenting to a Canadian paediatric ED were asked to complete a survey screening for FI along with health and demographic information. Results were compared to data collected in 2012. Multivariable logistic regression was used to measure associations with FI. Results: In 2021, 26% (n = 173/665) of families identified as food insecure compared to 22.7% in 2012 (n = 146/644) a difference of 3.3% (95% CI [−1.4%, 8.1%]). In multivariable analysis, greater number of children in the home (OR 1.19, 95% CI [1.01, 1.41]), financial strain from medical expenses (OR 5.31, 95% CI [3.45, 8.18]), and a lack of primary care access (OR 1.27, 95% CI [1.08, 1.51]) were independent predictors of FI. Less than half of families with FI reported use of food charity, most commonly food banks, while one-quarter received help from family or friends. Families experiencing FI expressed a preference for support through free or low-cost meals and financial assistance with medical expenses. Conclusion: More than one in four families attending a paediatric ED screened positive for FI. Future research is needed to examine the effect of support interventions for families assessed in medical care facilities including financial support for those with chronic medical conditions.
- 6 June 2023
- Published by Oxford University Press (OUP) in Paediatrics & Child Health
- Vol. 28 (4) , 229-234
Prevalence and characterization of food insecurity in a Canadian paediatric emergency department
Objectives: Food insecurity (FI) is associated with a number of adverse child health outcomes and increased emergency department (ED) use. The COVID-19 pandemic exacerbated the financial hardship faced by many families. We sought to determine the prevalence of FI among children with ED visits, compare this to pre-pandemic rates, and describe associated risk factors. Methods: From September to December 2021, families presenting to a Canadian paediatric ED were asked to complete a survey screening for FI along with health and demographic information. Results were compared to data collected in 2012. Multivariable logistic regression was used to measure associations with FI. Results: In 2021, 26% (n = 173/665) of families identified as food insecure compared to 22.7% in 2012 (n = 146/644) a difference of 3.3% (95% CI [−1.4%, 8.1%]). In multivariable analysis, greater number of children in the home (OR 1.19, 95% CI [1.01, 1.41]), financial strain from medical expenses (OR 5.31, 95% CI [3.45, 8.18]), and a lack of primary care access (OR 1.27, 95% CI [1.08, 1.51]) were independent predictors of FI. Less than half of families with FI reported use of food charity, most commonly food banks, while one-quarter received help from family or friends. Families experiencing FI expressed a preference for support through free or low-cost meals and financial assistance with medical expenses. Conclusion: More than one in four families attending a paediatric ED screened positive for FI. Future research is needed to examine the effect of support interventions for families assessed in medical care facilities including financial support for those with chronic medical conditions.
- Open Access
- 2 June 2023
- Published by Springer Nature in Canadian Journal of Emergency Medicine
- Vol. 25 (6) , 453-455
Vigilance and validity: the necessity of assessment system surveillance to ensure equity in emergency medicine
- 2 June 2023
- Published by Springer Nature in Canadian Journal of Emergency Medicine
- Vol. 25 (6) , 453-455
Open AccessVigilance and validity: the necessity of assessment system surveillance to ensure equity in emergency medicine
- 8 December 2022
- Published by Wiley in AEM Education and Training
- Vol. 6 (6) , e10822
Learning pediatric emergency medicine over time: A realist evaluation of a longitudinal pediatric emergency medicine clinical experience
Introduction: Emergency medicine (EM) practitioners must be proficient at caring for patients of all ages, including pediatric patients. Traditionally, EM trainees learn pediatric emergency medicine (PEM) through block rotations. This is problematic due to the seasonal nature of pediatric diseases and infrequent critical events. Spaced repetition learning theory suggests PEM would be better learned through longitudinal rotations. The transition to competency‐based medical education (CBME) in Canada is accelerating the need to find novel ways to attain competencies in postgraduate training. At McMaster University, senior EM trainees can choose either traditional PEM blocks or longitudinal rotations. Our objective was to understand how learners experience these different rotations given the transition to CBME in Canada.Methods: Using a realist framework of program evaluation, we conducted semistructured interviews with key stakeholders (trainees, program directors, attending physicians) in EM. The realist framework was used to understand how context interacts with theoretical mechanisms to produce outcomes of interest. Data were analyzed using inductive, conventional content analysis. All investigators coded a subset of transcripts independently and in duplicate to achieve intercoder agreement.Results: A total of 13 interviews were completed with trainees (n = 11) and staff physicians (n = 2). The learning experience exists within an educational and clinical context, which are logistically distinct but inseparable. The longitudinal learning experience appears to improve learning through spaced repetition, which prevents atrophy of skills and knowledge while also benefitting from the offsetting of seasonal variability associated with many pediatric diseases. Improved feedback and entrustment are facilitated through the building of coaching relationships over time. Barriers to the learning experience are related mainly to logistical difficulties associated with resolving longitudinal and blocked learning experiences. Improved relationships with the interprofessional team may provide distinct learning opportunities and improved team functioning. Block rotations were identified as more valuable to junior trainees learning fundamental concepts.Conclusions: Longitudinal learning provides numerous advantages to learning PEM, including increased case variety, spaced repetition of core concepts, and a perception of greater entrustment of the learner through formation of coaching relationships over time. Future projects looking to quantify the differences between longitudinal and block learning to objectively show a difference in skills and knowledge are needed.
- 8 December 2022
- Published by Wiley in AEM Education and Training
- Vol. 6 (6) , e10822
Learning pediatric emergency medicine over time: A realist evaluation of a longitudinal pediatric emergency medicine clinical experience
Introduction: Emergency medicine (EM) practitioners must be proficient at caring for patients of all ages, including pediatric patients. Traditionally, EM trainees learn pediatric emergency medicine (PEM) through block rotations. This is problematic due to the seasonal nature of pediatric diseases and infrequent critical events. Spaced repetition learning theory suggests PEM would be better learned through longitudinal rotations. The transition to competency‐based medical education (CBME) in Canada is accelerating the need to find novel ways to attain competencies in postgraduate training. At McMaster University, senior EM trainees can choose either traditional PEM blocks or longitudinal rotations. Our objective was to understand how learners experience these different rotations given the transition to CBME in Canada.Methods: Using a realist framework of program evaluation, we conducted semistructured interviews with key stakeholders (trainees, program directors, attending physicians) in EM. The realist framework was used to understand how context interacts with theoretical mechanisms to produce outcomes of interest. Data were analyzed using inductive, conventional content analysis. All investigators coded a subset of transcripts independently and in duplicate to achieve intercoder agreement.Results: A total of 13 interviews were completed with trainees (n = 11) and staff physicians (n = 2). The learning experience exists within an educational and clinical context, which are logistically distinct but inseparable. The longitudinal learning experience appears to improve learning through spaced repetition, which prevents atrophy of skills and knowledge while also benefitting from the offsetting of seasonal variability associated with many pediatric diseases. Improved feedback and entrustment are facilitated through the building of coaching relationships over time. Barriers to the learning experience are related mainly to logistical difficulties associated with resolving longitudinal and blocked learning experiences. Improved relationships with the interprofessional team may provide distinct learning opportunities and improved team functioning. Block rotations were identified as more valuable to junior trainees learning fundamental concepts.Conclusions: Longitudinal learning provides numerous advantages to learning PEM, including increased case variety, spaced repetition of core concepts, and a perception of greater entrustment of the learner through formation of coaching relationships over time. Future projects looking to quantify the differences between longitudinal and block learning to objectively show a difference in skills and knowledge are needed.
- Open Access
- 1 July 2020
- Published by Springer Nature in Advances in Simulation
- Vol. 5 (1) , 1-13
Development of an in situ simulation-based continuing professional development curriculum in pediatric emergency medicine
Background: Continuing professional development (CPD) activities delivered by simulation to independently practicing physicians are becoming increasingly popular. At present, the educational potential of such simulations is limited by the inability to create effective curricula for the CPD audience. In contrast to medical trainees, CPD activities lack pre-defined learning expectations and, instead, emphasize self-directed learning, which may not encompass true learning needs. We hypothesize that we could generate an interprofessional CPD simulation curriculum for practicing pediatric emergency medicine (PEM) physicians in a single-center tertiary care hospital using a deliberative approach combined with Kern’s six-step method of curriculum development. Methods: From a comprehensive core list of 94 possible PEM clinical presentations and procedures, we generated an 18-scenario CPD simulation curriculum. We conducted a comprehensive perceived and unperceived needs assessment on topics to include, incorporating opinions of faculty PEM physicians, hospital leadership, interprofessional colleagues, and expert opinion on patient benefit, simulation feasibility, and value of simulating the case for learning. To systematically rank items while balancing the needs of all stakeholders, we used a prioritization matrix to generate objective “priority scores.” These scores were used by CPD planners to deliberately determine the simulation curriculum contents. Results: We describe a novel three-step CPD simulation curriculum design method involving (1) systematic and deliberate needs assessment, (2) systematic prioritization, and (3) curriculum synthesis. Of practicing PEM physicians, 17/20 responded to the perceived learning needs survey, while 6/6 leaders responded to the unperceived needs assessment. These ranked data were input to a five-variable prioritization matrix generating priority scores. Based on local needs, the highest 18 scoring clinical presentations and procedures were selected for final inclusion in a PEM CPD simulation curriculum. An interim survey of PEM physician (21/24 respondents) opinions was collected, with 90% finding educational value with the curriculum. The curriculum includes items not identified by self-directed learning that PEM physicians thought should be included. Conclusions: We highlight a novel methodology for PEM physicians that can be adapted by other specialities when designing their own CPD simulation curriculum. This methodology objectively considers and prioritizes the needs of practicing physicians and stakeholders involved in CPD.
- 1 July 2020
- Published by Springer Nature in Advances in Simulation
- Vol. 5 (1) , 1-13
Open AccessDevelopment of an in situ simulation-based continuing professional development curriculum in pediatric emergency medicine
Background: Continuing professional development (CPD) activities delivered by simulation to independently practicing physicians are becoming increasingly popular. At present, the educational potential of such simulations is limited by the inability to create effective curricula for the CPD audience. In contrast to medical trainees, CPD activities lack pre-defined learning expectations and, instead, emphasize self-directed learning, which may not encompass true learning needs. We hypothesize that we could generate an interprofessional CPD simulation curriculum for practicing pediatric emergency medicine (PEM) physicians in a single-center tertiary care hospital using a deliberative approach combined with Kern’s six-step method of curriculum development. Methods: From a comprehensive core list of 94 possible PEM clinical presentations and procedures, we generated an 18-scenario CPD simulation curriculum. We conducted a comprehensive perceived and unperceived needs assessment on topics to include, incorporating opinions of faculty PEM physicians, hospital leadership, interprofessional colleagues, and expert opinion on patient benefit, simulation feasibility, and value of simulating the case for learning. To systematically rank items while balancing the needs of all stakeholders, we used a prioritization matrix to generate objective “priority scores.” These scores were used by CPD planners to deliberately determine the simulation curriculum contents. Results: We describe a novel three-step CPD simulation curriculum design method involving (1) systematic and deliberate needs assessment, (2) systematic prioritization, and (3) curriculum synthesis. Of practicing PEM physicians, 17/20 responded to the perceived learning needs survey, while 6/6 leaders responded to the unperceived needs assessment. These ranked data were input to a five-variable prioritization matrix generating priority scores. Based on local needs, the highest 18 scoring clinical presentations and procedures were selected for final inclusion in a PEM CPD simulation curriculum. An interim survey of PEM physician (21/24 respondents) opinions was collected, with 90% finding educational value with the curriculum. The curriculum includes items not identified by self-directed learning that PEM physicians thought should be included. Conclusions: We highlight a novel methodology for PEM physicians that can be adapted by other specialities when designing their own CPD simulation curriculum. This methodology objectively considers and prioritizes the needs of practicing physicians and stakeholders involved in CPD.
- Open Access
- 1 December 2013
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 8 (6) , 475
Board 222 - Program Innovations Abstract Large Scale Multi-Patient, Multi-Modal In-Situ Simulation with Lean and Human Factor Frameworks to Test Process and Environment of New Clinical Spaces. (Submission #525)
Introduction/Background Design of clinical areas requires consideration of intended use and workflow. Traditionally, clinical areas are designed from blueprints based on the functional content wish list of the clinical department. Lean methodology is used to reduce or eliminate wasted time, money and energy resulting in efficient, patient-focused systems. Lean focuses on systems, processes and environment, making it ideal for identifying latent conditions for medical error. High fidelity simulation offers the opportunity to evaluate clinical design from the idea stage through construction and eventual occupancy. Using multi-patient, multi-modal in-situ simulation layered with Lean and human factors frameworks and PDSA cycles, we conducted post construction testing of two new clinical spaces in a large academic pediatric tertiary care center. Methods A multidisciplinary steering group determined testing objectives through stakeholder focus groups and leadership interviews. Introductory lean and human factors prebriefing and training sessions were held for participants and observers. A 4 hour simulation was held for a 33 bed ED and a 5 hour simulation was held for a 12 bed PICU. Simulations were fully staffed with pan-disciplinary teams, both simulations interacted with the normally functioning hospital. Simulations were multi-modal with standardized patients and family members, low to high fidelity manikins and task trainers. Trained observer teams and simulation participants collected qualitative data using standardized collection tools. Observers included hospital leadership, front line staff and patient safety staff and physicians. Transcribed structured team debriefs ensured additional feedback on equipment, environment, process and work flow. Over 200 discrete issues identified in each of the simulations. Forty eight consolidated items requiring either a process or environmental change in the PICU simulation, 38 in the ED simulation. A subset of the consolidated items were classified as critical requiring process or environmental changes prior to the move to the new spaces. Simulation guided the orientation and education for the new clinical spaces and highlighted further areas for focused simulation-based testing. Results: Conclusion In-situ simulation can be used to evaluate environment and process to detect latent PST in new environments. Lean and human factors offer a structured framework to conduct in-situ simulations and analyze data. References 1. Hamman, W. R., Beaudin-Seiler, B. M., Beaubien, J. M., Gullickson, A. M., Gross, A. C., Orizondo-Korotko, K., Fuqua, W., & Lammers, R. (2009). Using in situ simulation to identify and resolve latent environmental threats to patient safety: Case study involving a labor and delivery ward. J Patient Saf, 5(3),184-187. 2. Kobayashi, L., Shapiro, M. J., Sucov, A., Woolard, R., MD, Boss R. M., Dunbar, J., Sciamacco, R., Karpik, K., & Gregory J. (2006). Portable advanced medical simulation for new emergency department testing and orientation. Academic Emergency Medicine, 13, 691-695. 3. Going Lean in Health Care.IHI Innovation Series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2005. (Available on http://www.IHI.org ). 4. Berwick D, Hackbarth A. Eliminating Waste in US Health Care. JAMA. 2012;307(14):1513-1516. Disclosures None.
- 1 December 2013
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 8 (6) , 475
Open AccessBoard 222 - Program Innovations Abstract Large Scale Multi-Patient, Multi-Modal In-Situ Simulation with Lean and Human Factor Frameworks to Test Process and Environment of New Clinical Spaces. (Submission #525)
Introduction/Background Design of clinical areas requires consideration of intended use and workflow. Traditionally, clinical areas are designed from blueprints based on the functional content wish list of the clinical department. Lean methodology is used to reduce or eliminate wasted time, money and energy resulting in efficient, patient-focused systems. Lean focuses on systems, processes and environment, making it ideal for identifying latent conditions for medical error. High fidelity simulation offers the opportunity to evaluate clinical design from the idea stage through construction and eventual occupancy. Using multi-patient, multi-modal in-situ simulation layered with Lean and human factors frameworks and PDSA cycles, we conducted post construction testing of two new clinical spaces in a large academic pediatric tertiary care center. Methods A multidisciplinary steering group determined testing objectives through stakeholder focus groups and leadership interviews. Introductory lean and human factors prebriefing and training sessions were held for participants and observers. A 4 hour simulation was held for a 33 bed ED and a 5 hour simulation was held for a 12 bed PICU. Simulations were fully staffed with pan-disciplinary teams, both simulations interacted with the normally functioning hospital. Simulations were multi-modal with standardized patients and family members, low to high fidelity manikins and task trainers. Trained observer teams and simulation participants collected qualitative data using standardized collection tools. Observers included hospital leadership, front line staff and patient safety staff and physicians. Transcribed structured team debriefs ensured additional feedback on equipment, environment, process and work flow. Over 200 discrete issues identified in each of the simulations. Forty eight consolidated items requiring either a process or environmental change in the PICU simulation, 38 in the ED simulation. A subset of the consolidated items were classified as critical requiring process or environmental changes prior to the move to the new spaces. Simulation guided the orientation and education for the new clinical spaces and highlighted further areas for focused simulation-based testing. Results: Conclusion In-situ simulation can be used to evaluate environment and process to detect latent PST in new environments. Lean and human factors offer a structured framework to conduct in-situ simulations and analyze data. References 1. Hamman, W. R., Beaudin-Seiler, B. M., Beaubien, J. M., Gullickson, A. M., Gross, A. C., Orizondo-Korotko, K., Fuqua, W., & Lammers, R. (2009). Using in situ simulation to identify and resolve latent environmental threats to patient safety: Case study involving a labor and delivery ward. J Patient Saf, 5(3),184-187. 2. Kobayashi, L., Shapiro, M. J., Sucov, A., Woolard, R., MD, Boss R. M., Dunbar, J., Sciamacco, R., Karpik, K., & Gregory J. (2006). Portable advanced medical simulation for new emergency department testing and orientation. Academic Emergency Medicine, 13, 691-695. 3. Going Lean in Health Care.IHI Innovation Series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2005. (Available on http://www.IHI.org ). 4. Berwick D, Hackbarth A. Eliminating Waste in US Health Care. JAMA. 2012;307(14):1513-1516. Disclosures None.