Bryan Harmer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Bryan Harmer has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Vitaliy Popov
University of Michigan Medical School
4 shared publications - Adam Lecznar
Department of Industrial and Entrepreneurial Engineering and Engineering Management, College of Engineering and Applied Sciences, Western Michigan University
2 shared publications - Autumn Edwards
Western Michigan University
2 shared publications Guan Hong
Department of Computer Science, College of Engineering and Applied Sciences, Western Michigan University
2 shared publications- John D. Hoyle
Department of Emergency Medicine, Western Michigan University Homer Stryker School of Medicine
2 shared publications - Kathryn Christopher
Department of Industrial and Entrepreneurial Engineering and Engineering Management, College of Engineering and Applied Sciences, Western Michigan University
2 shared publications
Latest Publications
- 10 March 2026
- Published by Taylor & Francis in Prehospital Emergency Care
- Vol. 30 (8) , 1214-1222
A Simulation-Based Root Cause Analysis of Pediatric Medication Dosing Errors in Emergency Medical Services
Prehospital pediatric medication administration (PMA) carries a persistent dosing error rate of approximately 31%, despite efforts to mitigate these events. While the characteristics of these errors are well documented, underlying latent conditions in the emergency medical services (EMS) system contributing to these errors are not well understood. The purpose of this study is to identify the root causes within the EMS system that contribute to these errors. This study builds upon our previous mixed-methods simulation-based study that identified the frequency and characteristics of active errors associated with PMA. Eleven two-person EMS crews from two agencies in Michigan each completed three simulated pediatric emergencies requiring two doses of epinephrine, midazolam, or fentanyl. Simulations were recorded, and a physician and paramedic measured the accuracy of dosage administration. Post-simulation interviews were conducted to investigate actions associated with error and potential contributing factors. A multidisciplinary team analyzed equipment, protocols, interviews, observer notes, and participant comments through a modified Delphi method, identifying latent conditions using a Root Cause Analysis and Action framework and categorized them using a human factors framework. Latent conditions were identified and categorized after two rounds of the modified Delphi method. These conditions were found in all five tiers of the human factors framework. They included: 1) Individual Characteristics: limited clinician experience, knowledge, stress, and anxiety; 2) Nature of Work: high task complexity and limited teamwork; 3) Human-System Interface: cognitive aid and medical device usability issues; 4) Management: limited employee training and development; and 5) External Environment: protocol issues and a lack of assistive technology. These results highlight the critical systemic vulnerabilities underlying PMA dosing errors in EMS, supporting that errors result from systemic issues rather than solely from individual actions. By addressing these systemic weaknesses with comprehensive strategies, progress can be made in effectively resolving the ongoing issue of PMA dosing errors in EMS.
- 10 March 2026
- Published by Taylor & Francis in Prehospital Emergency Care
- Vol. 30 (8) , 1214-1222
A Simulation-Based Root Cause Analysis of Pediatric Medication Dosing Errors in Emergency Medical Services
Prehospital pediatric medication administration (PMA) carries a persistent dosing error rate of approximately 31%, despite efforts to mitigate these events. While the characteristics of these errors are well documented, underlying latent conditions in the emergency medical services (EMS) system contributing to these errors are not well understood. The purpose of this study is to identify the root causes within the EMS system that contribute to these errors. This study builds upon our previous mixed-methods simulation-based study that identified the frequency and characteristics of active errors associated with PMA. Eleven two-person EMS crews from two agencies in Michigan each completed three simulated pediatric emergencies requiring two doses of epinephrine, midazolam, or fentanyl. Simulations were recorded, and a physician and paramedic measured the accuracy of dosage administration. Post-simulation interviews were conducted to investigate actions associated with error and potential contributing factors. A multidisciplinary team analyzed equipment, protocols, interviews, observer notes, and participant comments through a modified Delphi method, identifying latent conditions using a Root Cause Analysis and Action framework and categorized them using a human factors framework. Latent conditions were identified and categorized after two rounds of the modified Delphi method. These conditions were found in all five tiers of the human factors framework. They included: 1) Individual Characteristics: limited clinician experience, knowledge, stress, and anxiety; 2) Nature of Work: high task complexity and limited teamwork; 3) Human-System Interface: cognitive aid and medical device usability issues; 4) Management: limited employee training and development; and 5) External Environment: protocol issues and a lack of assistive technology. These results highlight the critical systemic vulnerabilities underlying PMA dosing errors in EMS, supporting that errors result from systemic issues rather than solely from individual actions. By addressing these systemic weaknesses with comprehensive strategies, progress can be made in effectively resolving the ongoing issue of PMA dosing errors in EMS.
- 9 March 2026
- Published by Taylor & Francis in Prehospital Emergency Care
- Vol. 30 (6) , 1-8
Assessing the Influence of a Statewide Dosing Reference Aid on Prehospital Pediatric Medication Dosing Errors: A Mixed-Methods Simulation-Based Investigation
Errors occur in 31% of prehospital pediatric medication administrations (PMA) in Michigan despite the implementation of the MI-MEDIC pediatric dosing reference aid. Reference aids may not effectively target the causes of dosing errors and could introduce new types of error. Our study examines the frequency, magnitude, and immediate causes of PMA dosing errors in emergency medical services (EMS) after implementation of the MI-MEDIC dosing reference aid. We used a mixed method, mobile simulation-based approach to examine PMA dosing errors. Emergency medical services crews were recruited from a private EMS service and a fire-based EMS service in Michigan. Each crew completed three high-fidelity simulations (infant seizure, infant cardiac arrest and child burn) requiring two doses of midazolam, epinephrine, or fentanyl. Post-simulation interviews were conducted. Error rates and magnitudes were analyzed using descriptive statistics. A multidisciplinary team used a modified Delphi method, incorporating simulation observations, interview recordings, pictures of equipment that were used during the simulations, and protocols to categorize observed errors and reach consensus on their immediate causes. Eleven crews were recruited between both agencies, completing 33 simulations and 66 medication administrations, using the MI-MEDIC dosing reference aid. Dosing errors occurred in 19 of the 66 doses (28.8%), with 13 underdoses (68.4%) and six overdoses (31.6%). The median underdose was 0.50 (95% IQR: 0.20-0.56). The median overdose was 2.00 (95% IQR: 1.40-12.50). After two rounds, Delphi consensus categorized 13 slips (68.4%), six mistakes (31.6%), and no lapses. Immediate causes included crews obtaining the wrong weight (4/19, 21.0%), a large volume of air present in the syringe (6/19, 31.6%) and improper dilution of medications when following instructions on the MI-MEDIC reference aid (6/19, 31.6%). The remaining three involved epinephrine administration directly from the prefilled syringe system (2/19, 10.5%) and an intentional underdose (1/19, 5.3%). PMA dosing errors persist at a high rate with the use of the MI-MEDIC dosing reference aid. Immediate causes of error involve incorrect weight, administering air, and improper dilution, which tools like the MI-MEDIC dosing reference aid do not address. Further research is needed to develop comprehensive strategies addressing the active errors identified in our study.
- 9 March 2026
- Published by Taylor & Francis in Prehospital Emergency Care
- Vol. 30 (6) , 1-8
Assessing the Influence of a Statewide Dosing Reference Aid on Prehospital Pediatric Medication Dosing Errors: A Mixed-Methods Simulation-Based Investigation
Errors occur in 31% of prehospital pediatric medication administrations (PMA) in Michigan despite the implementation of the MI-MEDIC pediatric dosing reference aid. Reference aids may not effectively target the causes of dosing errors and could introduce new types of error. Our study examines the frequency, magnitude, and immediate causes of PMA dosing errors in emergency medical services (EMS) after implementation of the MI-MEDIC dosing reference aid. We used a mixed method, mobile simulation-based approach to examine PMA dosing errors. Emergency medical services crews were recruited from a private EMS service and a fire-based EMS service in Michigan. Each crew completed three high-fidelity simulations (infant seizure, infant cardiac arrest and child burn) requiring two doses of midazolam, epinephrine, or fentanyl. Post-simulation interviews were conducted. Error rates and magnitudes were analyzed using descriptive statistics. A multidisciplinary team used a modified Delphi method, incorporating simulation observations, interview recordings, pictures of equipment that were used during the simulations, and protocols to categorize observed errors and reach consensus on their immediate causes. Eleven crews were recruited between both agencies, completing 33 simulations and 66 medication administrations, using the MI-MEDIC dosing reference aid. Dosing errors occurred in 19 of the 66 doses (28.8%), with 13 underdoses (68.4%) and six overdoses (31.6%). The median underdose was 0.50 (95% IQR: 0.20-0.56). The median overdose was 2.00 (95% IQR: 1.40-12.50). After two rounds, Delphi consensus categorized 13 slips (68.4%), six mistakes (31.6%), and no lapses. Immediate causes included crews obtaining the wrong weight (4/19, 21.0%), a large volume of air present in the syringe (6/19, 31.6%) and improper dilution of medications when following instructions on the MI-MEDIC reference aid (6/19, 31.6%). The remaining three involved epinephrine administration directly from the prefilled syringe system (2/19, 10.5%) and an intentional underdose (1/19, 5.3%). PMA dosing errors persist at a high rate with the use of the MI-MEDIC dosing reference aid. Immediate causes of error involve incorrect weight, administering air, and improper dilution, which tools like the MI-MEDIC dosing reference aid do not address. Further research is needed to develop comprehensive strategies addressing the active errors identified in our study.
- Open Access
- 14 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computing for Healthcare
- Vol. 7 (1) , 1-31
AutoCLC: Towards Automated Assessment and Feedback on Closed-Loop Communication in Team-based Healthcare Simulation Training
This study introduces AutoCLC, an AI-powered system designed to assess and provide feedback on Closed-Loop Communication (CLC) in professional learning environments. CLC, where a sender’s Call-Out statement is acknowledged by the receiver’s Check-Back statement, is a critical safety protocol in high-reliability domains, including emergency medicine resuscitation teams. Existing methods for evaluating CLC lack quantifiable metrics and depend heavily on human observation. AutoCLC addresses these limitations by leveraging natural language processing and large language models to analyze audio recordings from Advanced Cardiovascular Life Support (ACLS) simulation training. The system identifies CLC instances, measures their frequency and rate per minute, and categorizes communications as effective, incomplete, or missed. Technical evaluations demonstrate that AutoCLC achieves 78.9% precision for identifying Call-Outs and 74.3% for Check-Backs, with a performance gap of only 5% compared to human annotations. A user study involving 11 cardiac arrest instructors across three training sites supported the need for automated CLC assessment. Instructors found AutoCLC reports valuable for quantifying CLC frequency and quality, as well as for providing actionable, example-based feedback. Participants rated AutoCLC highly, with a System Usability Scale score of 76.4%, reflecting above-average usability. This work represents a significant step toward developing scalable, data-driven feedback systems that enhance individual skills and team performance in high-reliability settings.
- 14 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computing for Healthcare
- Vol. 7 (1) , 1-31
Open AccessAutoCLC: Towards Automated Assessment and Feedback on Closed-Loop Communication in Team-based Healthcare Simulation Training
This study introduces AutoCLC, an AI-powered system designed to assess and provide feedback on Closed-Loop Communication (CLC) in professional learning environments. CLC, where a sender’s Call-Out statement is acknowledged by the receiver’s Check-Back statement, is a critical safety protocol in high-reliability domains, including emergency medicine resuscitation teams. Existing methods for evaluating CLC lack quantifiable metrics and depend heavily on human observation. AutoCLC addresses these limitations by leveraging natural language processing and large language models to analyze audio recordings from Advanced Cardiovascular Life Support (ACLS) simulation training. The system identifies CLC instances, measures their frequency and rate per minute, and categorizes communications as effective, incomplete, or missed. Technical evaluations demonstrate that AutoCLC achieves 78.9% precision for identifying Call-Outs and 74.3% for Check-Backs, with a performance gap of only 5% compared to human annotations. A user study involving 11 cardiac arrest instructors across three training sites supported the need for automated CLC assessment. Instructors found AutoCLC reports valuable for quantifying CLC frequency and quality, as well as for providing actionable, example-based feedback. Participants rated AutoCLC highly, with a System Usability Scale score of 76.4%, reflecting above-average usability. This work represents a significant step toward developing scalable, data-driven feedback systems that enhance individual skills and team performance in high-reliability settings.
- 22 December 2025
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 21 (1) , 48-56
Development and Evaluation of a Multimodal Debriefing Dashboard for Virtual Reality Cardiac Arrest Simulation
Introduction: Wearable sensing technologies incorporated into virtual reality (VR) headsets can provide a number of unique, previously hidden insights into individual and team learning and performance in complex environments. However, the most impactful and efficient mechanisms for conveying multimodal data (e.g., gaze, mental workload, etc) allowing for unique insights are not well understood. This study used a human-centered design process to develop and evaluate a multimodal debriefing dashboard. Methods: Twelve Advanced Cardiac Life Support (ACLS) Instructors completed VR cardiac arrest simulations and participated in interviews and design thinking workshops to identify dashboard features, leading to high-fidelity mock-ups and an interactive prototype. A second group of 6 ACLS instructors then evaluated the prototype by providing mock feedback on simulation performance with and without the dashboard in a pre-post format, followed by surveys assessing usability, acceptability, appropriateness, feasibility, trust, and perceived accuracy. Results: The final prototype dashboard features a video, a timeline of clinical actions, automatic error identification, mental workload, and visual attention data. It also generates closed-loop communication reports on a separate webpage. The evaluation study showed that participants provided performance analysis and feedback to students when using the dashboard, targeting specific (non)technical skills aligned with ACLS learning objectives. Participants rated the dashboard highly, with a System Usability Scale score of 88.9%, reflecting above-average usability. Conclusions: An interactive multimodal debriefing dashboard prototype was developed using a user-design framework with prototyping and iterative feedback. Use of the dashboard resulted in improved evaluation and debriefing practices targeting learning outcomes, with participants rating the dashboard favorably. This dashboard has the potential to enhance simulation-based learning by offering near real-time analytics that promote a deeper understanding of individual and team technical and nontechnical skill acquisition and mastery.
- 22 December 2025
- Published by Wolters Kluwer Health in Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Vol. 21 (1) , 48-56
Development and Evaluation of a Multimodal Debriefing Dashboard for Virtual Reality Cardiac Arrest Simulation
Introduction: Wearable sensing technologies incorporated into virtual reality (VR) headsets can provide a number of unique, previously hidden insights into individual and team learning and performance in complex environments. However, the most impactful and efficient mechanisms for conveying multimodal data (e.g., gaze, mental workload, etc) allowing for unique insights are not well understood. This study used a human-centered design process to develop and evaluate a multimodal debriefing dashboard. Methods: Twelve Advanced Cardiac Life Support (ACLS) Instructors completed VR cardiac arrest simulations and participated in interviews and design thinking workshops to identify dashboard features, leading to high-fidelity mock-ups and an interactive prototype. A second group of 6 ACLS instructors then evaluated the prototype by providing mock feedback on simulation performance with and without the dashboard in a pre-post format, followed by surveys assessing usability, acceptability, appropriateness, feasibility, trust, and perceived accuracy. Results: The final prototype dashboard features a video, a timeline of clinical actions, automatic error identification, mental workload, and visual attention data. It also generates closed-loop communication reports on a separate webpage. The evaluation study showed that participants provided performance analysis and feedback to students when using the dashboard, targeting specific (non)technical skills aligned with ACLS learning objectives. Participants rated the dashboard highly, with a System Usability Scale score of 88.9%, reflecting above-average usability. Conclusions: An interactive multimodal debriefing dashboard prototype was developed using a user-design framework with prototyping and iterative feedback. Use of the dashboard resulted in improved evaluation and debriefing practices targeting learning outcomes, with participants rating the dashboard favorably. This dashboard has the potential to enhance simulation-based learning by offering near real-time analytics that promote a deeper understanding of individual and team technical and nontechnical skill acquisition and mastery.
- Open Access
- 8 July 2024
- Published by National EMS Management Association in International Journal of Paramedicine
- No. 7,p. 94-105
Factors Associated with Increased Use of Cognitive Aids in Emergency Medical Services
Background: Cognitive aids are an essential aspect of patient care within emergency medical services (EMS). Despite their availability in EMS, these aids are underutilized. Understanding factors associated with increased use of cognitive aids can help guide the development of effective implementation strategies. This study examines the association between the frequency of cognitive aid use in EMS and three factors: the use of these aids into initial education programs, policies mandating their use, and clinicians’ perceptions of cognitive aid usefulness. Methods: This study used a cross-sectional survey examining the use, previous training, policy, and perceived usefulness of 15 selected cognitive aids. The survey was emailed to 136,093 EMS clinicians in six participating states (TX, ME, MI, LA, SC, and AR). Descriptive statistics were used to describe the examined factors. Bivariate analysis was used to examine the relationship between the use of each cognitive aid and previous training with the aid, requirements for use, and perceived usefulness. Results: A total of 2,251 respondents met inclusion criteria and were included in the study. The length-based tape was the most common aid used during initial education programs (n=1724, 77.0%) and to have policy requiring its use during patient care (n=1194, 53.0%). Aids associated with pediatric medication administration were perceived as most useful. Clinicians were more likely to use a specific aid if there was policy requiring its use, if they used the aid during their initial education programs, or if they perceived it to be useful. Conclusions: The results of this study suggest that integrating a cognitive aid into EMS initial education programs, having policy requiring its use, and the aid being perceived as useful are all associated with increased use the aid during patient care. These results may provide valuable insights for devising more effective implementation strategies for cognitive aids.
- 8 July 2024
- Published by National EMS Management Association in International Journal of Paramedicine
- No. 7,p. 94-105
Open AccessFactors Associated with Increased Use of Cognitive Aids in Emergency Medical Services
Background: Cognitive aids are an essential aspect of patient care within emergency medical services (EMS). Despite their availability in EMS, these aids are underutilized. Understanding factors associated with increased use of cognitive aids can help guide the development of effective implementation strategies. This study examines the association between the frequency of cognitive aid use in EMS and three factors: the use of these aids into initial education programs, policies mandating their use, and clinicians’ perceptions of cognitive aid usefulness. Methods: This study used a cross-sectional survey examining the use, previous training, policy, and perceived usefulness of 15 selected cognitive aids. The survey was emailed to 136,093 EMS clinicians in six participating states (TX, ME, MI, LA, SC, and AR). Descriptive statistics were used to describe the examined factors. Bivariate analysis was used to examine the relationship between the use of each cognitive aid and previous training with the aid, requirements for use, and perceived usefulness. Results: A total of 2,251 respondents met inclusion criteria and were included in the study. The length-based tape was the most common aid used during initial education programs (n=1724, 77.0%) and to have policy requiring its use during patient care (n=1194, 53.0%). Aids associated with pediatric medication administration were perceived as most useful. Clinicians were more likely to use a specific aid if there was policy requiring its use, if they used the aid during their initial education programs, or if they perceived it to be useful. Conclusions: The results of this study suggest that integrating a cognitive aid into EMS initial education programs, having policy requiring its use, and the aid being perceived as useful are all associated with increased use the aid during patient care. These results may provide valuable insights for devising more effective implementation strategies for cognitive aids.