Teodor P. Grantcharov
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Teodor P. Grantcharov has a total of 126 co-authors. Here are the top co-authors by number of shared publications:
- Mitchell Geoffrey Goldenberg
Department of Urology, University of Southern California, Los Angeles, USA
6 shared publications - Peter Szasz
Department of Surgery, St. Michael's Hospital, Toronto, Canada
5 shared publications - Andras B. Fecso
Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, Canada
4 shared publications - James J. Jung
Department of Surgery, Duke University, Durham, USA
4 shared publications - Jeanett Strandbygaard
Department of Obstetrics and Gynecology, The Juliane Marie Centre for Children, Women and Reproduction, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
4 shared publications - Jette Led Sørensen
Mary Elizabeth’s Hospital and Juliane Marie Centre, Copenhagen University Hospital – Rigshospitalet, Copenhagen, Denmark
4 shared publications
Latest Publications
- Open Access
Automated Video-Based Analysis of Surgical Meta-competencies Using Computer Vision
Background: Traditional surgical training relies on an apprenticeship model, which is subjective and threatened by human bias. Performance metric scales attempt to offer more objective feedback by providing a structured grading rubric, but these scores are still ultimately subjective. Leveraging computer vision and artificial intelligence to assess surgical performance has the potential to shift subjective measurements into automated and objective feedback for trainees. Materials and Methods: This retrospective, multi-institutional study analyzed 319 laparoscopic cholecystectomy videos from IRB-approved deidentified datasets and segmented the videos into 2862 clips. Using an internally validated video-based assessment rubric, we annotated video clips across five metacompetency domains: tissue handling, psychomotor skills, efficiency, dissection quality, and exposure quality. Short video segments ( < 90s) were rated on a 5-point scale by expert raters. We trained a deep learning model (DINOv2) to classify composite high (4–5) vs low (1–3) metacompetency scores, representing yes/no binary feedback, a realistic comparison to the operating room. Model performance was evaluated via area under the receiver operating characteristic curve. Results: Among 2862 LC video clips, model performance was highest for dissection quality during the exposing gallbladder step (AUROC 91.5%, 95% confidence interval [CI], 84.5-96.5). Moderate performance was observed for efficiency (AUROC 72.6%, 95% CI 59.9-83.2) and exposure quality (AUROC 68.7%, 95% CI 55.2-81.8). Dissection and exposure quality scores during hepatocystic triangle dissection yielded AUROCs of 63.8% (95% CI 56.9-71.3) and 66.0% (95% CI 53.1-76.7), respectively. Conclusion: We demonstrate the feasibility of a purely vision-based deep learning model to grade surgical skill based on metacompetencies with excellent performance during simple steps. This technique represents an advance over prior whole-video approaches that rely heavily on tool- tracking and kinematic data, and may lead to greater model performance by using binary feedback on increasingly specific step segmentation.
Open AccessAutomated Video-Based Analysis of Surgical Meta-competencies Using Computer Vision
Background: Traditional surgical training relies on an apprenticeship model, which is subjective and threatened by human bias. Performance metric scales attempt to offer more objective feedback by providing a structured grading rubric, but these scores are still ultimately subjective. Leveraging computer vision and artificial intelligence to assess surgical performance has the potential to shift subjective measurements into automated and objective feedback for trainees. Materials and Methods: This retrospective, multi-institutional study analyzed 319 laparoscopic cholecystectomy videos from IRB-approved deidentified datasets and segmented the videos into 2862 clips. Using an internally validated video-based assessment rubric, we annotated video clips across five metacompetency domains: tissue handling, psychomotor skills, efficiency, dissection quality, and exposure quality. Short video segments ( < 90s) were rated on a 5-point scale by expert raters. We trained a deep learning model (DINOv2) to classify composite high (4–5) vs low (1–3) metacompetency scores, representing yes/no binary feedback, a realistic comparison to the operating room. Model performance was evaluated via area under the receiver operating characteristic curve. Results: Among 2862 LC video clips, model performance was highest for dissection quality during the exposing gallbladder step (AUROC 91.5%, 95% confidence interval [CI], 84.5-96.5). Moderate performance was observed for efficiency (AUROC 72.6%, 95% CI 59.9-83.2) and exposure quality (AUROC 68.7%, 95% CI 55.2-81.8). Dissection and exposure quality scores during hepatocystic triangle dissection yielded AUROCs of 63.8% (95% CI 56.9-71.3) and 66.0% (95% CI 53.1-76.7), respectively. Conclusion: We demonstrate the feasibility of a purely vision-based deep learning model to grade surgical skill based on metacompetencies with excellent performance during simple steps. This technique represents an advance over prior whole-video approaches that rely heavily on tool- tracking and kinematic data, and may lead to greater model performance by using binary feedback on increasingly specific step segmentation.
- Open Access
- 17 July 2025
- Published by Springer Nature in Surgical Endoscopy
- Vol. 39 (9) , 5742-5754
Does the Surgical Safety Checklist need a co-pilot? Comparing adherence in gynecological surgery through electronic medical records and OR Black Box video observations
Background: Despite clear evidence that the Surgical Safety Checklist improves patient safety, the way its use is reported in the literature varies significantly. Consequently, we must understand the alignment between reported use of the checklist and its actual application to identify discrepancies that could affect safety reporting accuracy, and ultimately, patient safety outcomes. The study aims to examine Surgical Safety Checklist adherence in a gynecological operating room based on video data and to compare the resulting findings with reported use in patient electronic medical records. Method: An observational study was conducted on elective gynecological surgeries in a single operating room equipped with an OR Black Box from August to October 2021 to assess checklist compliance, quality, and engagement. The checklist’s reported use in patient electronic medical records was reviewed. Results: Forty-five surgeries were assessed. The video observed compliance score for Sign-in and Time-out was 100%, but 80% for Sign-out. Engagement scores, i.e., percentage of people paused, varied during the three checklist phases, with an overall mean score of 76% (range 45–94%). Quality scores, i.e., percentage of checklist items completed, differed between video observed (47% (95% CI 43–50)) and electronic medical records reported (89% (95% CI 84–94)) use. Conclusions: OR Black Box video provides a unique opportunity to assess the actual use of the Surgical Safety Checklist, revealing valuable insights into how it was used. Data showed that the checklist was not used as intended. A discrepancy was found between the reported completion in the electronic medical records and its actual use as observed in the video, with the former showing a much higher completion rate. This large discrepancy highlights the need for further initiatives to improve checklist use and reporting.
- 17 July 2025
- Published by Springer Nature in Surgical Endoscopy
- Vol. 39 (9) , 5742-5754
Open AccessDoes the Surgical Safety Checklist need a co-pilot? Comparing adherence in gynecological surgery through electronic medical records and OR Black Box video observations
Background: Despite clear evidence that the Surgical Safety Checklist improves patient safety, the way its use is reported in the literature varies significantly. Consequently, we must understand the alignment between reported use of the checklist and its actual application to identify discrepancies that could affect safety reporting accuracy, and ultimately, patient safety outcomes. The study aims to examine Surgical Safety Checklist adherence in a gynecological operating room based on video data and to compare the resulting findings with reported use in patient electronic medical records. Method: An observational study was conducted on elective gynecological surgeries in a single operating room equipped with an OR Black Box from August to October 2021 to assess checklist compliance, quality, and engagement. The checklist’s reported use in patient electronic medical records was reviewed. Results: Forty-five surgeries were assessed. The video observed compliance score for Sign-in and Time-out was 100%, but 80% for Sign-out. Engagement scores, i.e., percentage of people paused, varied during the three checklist phases, with an overall mean score of 76% (range 45–94%). Quality scores, i.e., percentage of checklist items completed, differed between video observed (47% (95% CI 43–50)) and electronic medical records reported (89% (95% CI 84–94)) use. Conclusions: OR Black Box video provides a unique opportunity to assess the actual use of the Surgical Safety Checklist, revealing valuable insights into how it was used. Data showed that the checklist was not used as intended. A discrepancy was found between the reported completion in the electronic medical records and its actual use as observed in the video, with the former showing a much higher completion rate. This large discrepancy highlights the need for further initiatives to improve checklist use and reporting.
- Open Access
- 9 December 2024
- Published by BMJ in BMJ Open Quality
- Vol. 13 (4) , e003154
Healthcare professionals’ perception of the World Health Organization Surgical Safety Checklist and psychological safety: a cross-sectional survey
Background: The Surgical Safety Checklist (SSC) is a cornerstone of ensuring the safety and accuracy of communication among interdisciplinary teams in the operating room. Central to the successful implementation of such a checklist is the concept of psychological safety. Despite the extensive body of research on the checklists’ efficacy, the association between healthcare professionals’ (HCPs) perceptions of the checklist and their level of psychological safety remains uninvestigated. This study attempts to address this gap by examining how their perceptions of the checklist intersect with their sense of psychological safety. Methods: A cross-sectional survey comprising 25 items was conducted from November 2022 to January 2023 on; Demographics (6 items), the SSC (12 items), and the Psychological Safety Scale (7 items). We invited 125 HCPs from five different professional groups in the operation ward to complete the survey. Results: Of the 125 asked to participate, 107 responded, and 100 of whom completed the entire survey. The level of psychological safety increased by 1.25 (95 % CI 0.36 to 2.14, p=0.006) per one-point increase of the perception that colleagues listen when checklist items are being reviewed, and increased by 1.1 (95% CI 0.4 to 1.7, p=0.002) per one-point increase in the perception that the checklist enhances interdisciplinary teamwork, and increased by 0.86 (95% CI 0.15 to 1.57, p=0.02) per one-point increase in the perception that the checklist provides structure in the operating room. Conversely, the level of psychological safety decreased by 1.4 (95 % CI 0.5 to 2.3, p=0.004) per one-point increase in the perception that the checklist is time-consuming. Conclusion: Our findings reveal a significant association between psychological safety levels and perceptions of the SSC. Increased psychological safety was linked to more positive views on the checklist’s role in enhancing interdisciplinary teamwork, creating structure and attentiveness among colleagues. While seeing the checklist as time-consuming was associated with a lower psychological safety rating. These results suggest that psychological safety influences how individuals view and engage with patient safety measures like the checklist, highlighting the importance of fostering a supportive environment to optimise safety practice.
- 9 December 2024
- Published by BMJ in BMJ Open Quality
- Vol. 13 (4) , e003154
Open AccessHealthcare professionals’ perception of the World Health Organization Surgical Safety Checklist and psychological safety: a cross-sectional survey
Background: The Surgical Safety Checklist (SSC) is a cornerstone of ensuring the safety and accuracy of communication among interdisciplinary teams in the operating room. Central to the successful implementation of such a checklist is the concept of psychological safety. Despite the extensive body of research on the checklists’ efficacy, the association between healthcare professionals’ (HCPs) perceptions of the checklist and their level of psychological safety remains uninvestigated. This study attempts to address this gap by examining how their perceptions of the checklist intersect with their sense of psychological safety. Methods: A cross-sectional survey comprising 25 items was conducted from November 2022 to January 2023 on; Demographics (6 items), the SSC (12 items), and the Psychological Safety Scale (7 items). We invited 125 HCPs from five different professional groups in the operation ward to complete the survey. Results: Of the 125 asked to participate, 107 responded, and 100 of whom completed the entire survey. The level of psychological safety increased by 1.25 (95 % CI 0.36 to 2.14, p=0.006) per one-point increase of the perception that colleagues listen when checklist items are being reviewed, and increased by 1.1 (95% CI 0.4 to 1.7, p=0.002) per one-point increase in the perception that the checklist enhances interdisciplinary teamwork, and increased by 0.86 (95% CI 0.15 to 1.57, p=0.02) per one-point increase in the perception that the checklist provides structure in the operating room. Conversely, the level of psychological safety decreased by 1.4 (95 % CI 0.5 to 2.3, p=0.004) per one-point increase in the perception that the checklist is time-consuming. Conclusion: Our findings reveal a significant association between psychological safety levels and perceptions of the SSC. Increased psychological safety was linked to more positive views on the checklist’s role in enhancing interdisciplinary teamwork, creating structure and attentiveness among colleagues. While seeing the checklist as time-consuming was associated with a lower psychological safety rating. These results suggest that psychological safety influences how individuals view and engage with patient safety measures like the checklist, highlighting the importance of fostering a supportive environment to optimise safety practice.
- Open Access
- 9 January 2024
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 280 (1) , 75-81
Using the Operating Room Black Box to Assess Surgical Team Member Adaptation Under Uncertainty
Objective: Identify how surgical team members uniquely contribute to teamwork and adapt their teamwork skills during instances of uncertainty. Background: The importance of surgical teamwork in preventing patient harm is well documented. Yet, little is known about how key roles (nurse, anesthesiologist, surgeon, and medical trainee) uniquely contribute to teamwork during instances of uncertainty, particularly when adapting to and rectifying an intraoperative adverse event (IAE). Methods: Audiovisual data of 23 laparoscopic cases from a large community teaching hospital were prospectively captured using OR Black Box. Human factors researchers retrospectively coded videos for teamwork skills (backup behavior, coordination, psychological safety, situation assessment, team decision-making, and leadership) by team role under 2 conditions of uncertainty: associated with an IAE versus no IAE. Surgeons identified IAEs. Results: In all, 1015 instances of teamwork skills were observed. Nurses adapted to IAEs by expressing more backup behavior skills (5.3× increase; 13.9 instances/hour during an IAE vs 2.2 instances/hour when no IAE) while surgeons and medical trainees expressed more psychological safety skills (surgeons: 3.6× increase; 30.0 instances/hour vs 6.6 instances/hour and trainees: 6.6× increase; 31.2 instances/hour vs 4.1 instances/hour). All roles expressed fewer situation assessment skills during an IAE versus no IAE. Conclusions: OR Black Box enabled the assessment of critically important details about how team members uniquely contribute during instances of uncertainty. Some teamwork skills were amplified, while others dampened when dealing with IAEs. The knowledge of how each role contributes to teamwork and adapts to IAEs should be used to inform the design of tailored interventions to strengthen interprofessional teamwork.
- 9 January 2024
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 280 (1) , 75-81
Open AccessUsing the Operating Room Black Box to Assess Surgical Team Member Adaptation Under Uncertainty
Objective: Identify how surgical team members uniquely contribute to teamwork and adapt their teamwork skills during instances of uncertainty. Background: The importance of surgical teamwork in preventing patient harm is well documented. Yet, little is known about how key roles (nurse, anesthesiologist, surgeon, and medical trainee) uniquely contribute to teamwork during instances of uncertainty, particularly when adapting to and rectifying an intraoperative adverse event (IAE). Methods: Audiovisual data of 23 laparoscopic cases from a large community teaching hospital were prospectively captured using OR Black Box. Human factors researchers retrospectively coded videos for teamwork skills (backup behavior, coordination, psychological safety, situation assessment, team decision-making, and leadership) by team role under 2 conditions of uncertainty: associated with an IAE versus no IAE. Surgeons identified IAEs. Results: In all, 1015 instances of teamwork skills were observed. Nurses adapted to IAEs by expressing more backup behavior skills (5.3× increase; 13.9 instances/hour during an IAE vs 2.2 instances/hour when no IAE) while surgeons and medical trainees expressed more psychological safety skills (surgeons: 3.6× increase; 30.0 instances/hour vs 6.6 instances/hour and trainees: 6.6× increase; 31.2 instances/hour vs 4.1 instances/hour). All roles expressed fewer situation assessment skills during an IAE versus no IAE. Conclusions: OR Black Box enabled the assessment of critically important details about how team members uniquely contribute during instances of uncertainty. Some teamwork skills were amplified, while others dampened when dealing with IAEs. The knowledge of how each role contributes to teamwork and adapts to IAEs should be used to inform the design of tailored interventions to strengthen interprofessional teamwork.
- Open Access
- 20 February 2023
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 12 (4) , 1687
Automated Capture of Intraoperative Adverse Events Using Artificial Intelligence: A Systematic Review and Meta-Analysis
Intraoperative adverse events (iAEs) impact the outcomes of surgery, and yet are not routinely collected, graded, and reported. Advancements in artificial intelligence (AI) have the potential to power real-time, automatic detection of these events and disrupt the landscape of surgical safety through the prediction and mitigation of iAEs. We sought to understand the current implementation of AI in this space. A literature review was performed to PRISMA-DTA standards. Included articles were from all surgical specialties and reported the automatic identification of iAEs in real-time. Details on surgical specialty, adverse events, technology used for detecting iAEs, AI algorithm/validation, and reference standards/conventional parameters were extracted. A meta-analysis of algorithms with available data was conducted using a hierarchical summary receiver operating characteristic curve (ROC). The QUADAS-2 tool was used to assess the article risk of bias and clinical applicability. A total of 2982 studies were identified by searching PubMed, Scopus, Web of Science, and IEEE Xplore, with 13 articles included for data extraction. The AI algorithms detected bleeding (n = 7), vessel injury (n = 1), perfusion deficiencies (n = 1), thermal damage (n = 1), and EMG abnormalities (n = 1), among other iAEs. Nine of the thirteen articles described at least one validation method for the detection system; five explained using cross-validation and seven divided the dataset into training and validation cohorts. Meta-analysis showed the algorithms were both sensitive and specific across included iAEs (detection OR 14.74, CI 4.7–46.2). There was heterogeneity in reported outcome statistics and article bias risk. There is a need for standardization of iAE definitions, detection, and reporting to enhance surgical care for all patients. The heterogeneous applications of AI in the literature highlights the pluripotent nature of this technology. Applications of these algorithms across a breadth of urologic procedures should be investigated to assess the generalizability of these data.
- 20 February 2023
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 12 (4) , 1687
Open AccessAutomated Capture of Intraoperative Adverse Events Using Artificial Intelligence: A Systematic Review and Meta-Analysis
Intraoperative adverse events (iAEs) impact the outcomes of surgery, and yet are not routinely collected, graded, and reported. Advancements in artificial intelligence (AI) have the potential to power real-time, automatic detection of these events and disrupt the landscape of surgical safety through the prediction and mitigation of iAEs. We sought to understand the current implementation of AI in this space. A literature review was performed to PRISMA-DTA standards. Included articles were from all surgical specialties and reported the automatic identification of iAEs in real-time. Details on surgical specialty, adverse events, technology used for detecting iAEs, AI algorithm/validation, and reference standards/conventional parameters were extracted. A meta-analysis of algorithms with available data was conducted using a hierarchical summary receiver operating characteristic curve (ROC). The QUADAS-2 tool was used to assess the article risk of bias and clinical applicability. A total of 2982 studies were identified by searching PubMed, Scopus, Web of Science, and IEEE Xplore, with 13 articles included for data extraction. The AI algorithms detected bleeding (n = 7), vessel injury (n = 1), perfusion deficiencies (n = 1), thermal damage (n = 1), and EMG abnormalities (n = 1), among other iAEs. Nine of the thirteen articles described at least one validation method for the detection system; five explained using cross-validation and seven divided the dataset into training and validation cohorts. Meta-analysis showed the algorithms were both sensitive and specific across included iAEs (detection OR 14.74, CI 4.7–46.2). There was heterogeneity in reported outcome statistics and article bias risk. There is a need for standardization of iAE definitions, detection, and reporting to enhance surgical care for all patients. The heterogeneous applications of AI in the literature highlights the pluripotent nature of this technology. Applications of these algorithms across a breadth of urologic procedures should be investigated to assess the generalizability of these data.
- 29 July 2022
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 278 (1) , e5-e12
Surgeons’ Leadership Style and Team Behavior in the Hybrid Operating Room
Objective: This study aimed to assess the relationship between surgeons’ leadership style and team behavior in the hybrid operating room through video coding. Secondly, possible fluctuations possible fluctuations in leadership styles and team behavior during operative phases were studied. Background: Leadership is recognized as a key component to successful team functioning in high-risk industries. The ‘full range of leadership’ theory is commonly used to evaluate leadership, marking transformational, transactional, and passive. Few studies have examined the effects of these leadership styles on team behavior in surgery and/or their fluctuations during surgery. Methods: A single-center study included patients planned for routine endovascular procedures. A medical data capture system was used to allow post hoc video coding through Behavior Anchored Rating Scales. Multilevel statistical analysis was performed to assess possible correlations between leadership style and 3 team behavior indicators (speaking up, knowledge sharing, and collaboration) on an operative phase level. Results: Twenty-two cases were analyzed (47 hours recording). Transformational leadership is positively related to the extent to which team members work together (γ=0.20, PPPP=0.004). Leadership style and team behavior clearly fluctuate during a procedure, with similar patterns across different types of endovascular procedures. Conclusions: Consistent with other professional fields, surgeons’ transformational leadership enhances team behavior, especially during the most complex operative phases. This suggests that encouraging surgeons to learn and actively implement a transformational leadership style is meaningful to enhance patient safety and team performance.
- 29 July 2022
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 278 (1) , e5-e12
Surgeons’ Leadership Style and Team Behavior in the Hybrid Operating Room
Objective: This study aimed to assess the relationship between surgeons’ leadership style and team behavior in the hybrid operating room through video coding. Secondly, possible fluctuations possible fluctuations in leadership styles and team behavior during operative phases were studied. Background: Leadership is recognized as a key component to successful team functioning in high-risk industries. The ‘full range of leadership’ theory is commonly used to evaluate leadership, marking transformational, transactional, and passive. Few studies have examined the effects of these leadership styles on team behavior in surgery and/or their fluctuations during surgery. Methods: A single-center study included patients planned for routine endovascular procedures. A medical data capture system was used to allow post hoc video coding through Behavior Anchored Rating Scales. Multilevel statistical analysis was performed to assess possible correlations between leadership style and 3 team behavior indicators (speaking up, knowledge sharing, and collaboration) on an operative phase level. Results: Twenty-two cases were analyzed (47 hours recording). Transformational leadership is positively related to the extent to which team members work together (γ=0.20, PPPP=0.004). Leadership style and team behavior clearly fluctuate during a procedure, with similar patterns across different types of endovascular procedures. Conclusions: Consistent with other professional fields, surgeons’ transformational leadership enhances team behavior, especially during the most complex operative phases. This suggests that encouraging surgeons to learn and actively implement a transformational leadership style is meaningful to enhance patient safety and team performance.
- 22 July 2021
- Published by Springer Nature in Obesity Surgery
- Vol. 31 (10) , 4257-4263
Development of an International Standardized Curriculum for Laparoscopic Sleeve Gastrectomy Teaching Utilizing Modified Delphi Methodology
Background The performance of laparoscopic sleeve gastrectomy has increased markedly to become the single-most performed bariatric surgical procedure globally. To date, a means of standardized trainee teaching has not been developed. The aim of this study was to design a laparoscopic curriculum for trainees of bariatric surgery utilizing modified Delphi consensus methodology. Methods A panel of surgeons was assembled to devise an academic framework of technical, non-technical and cognitive skills utilized in the performance of laparoscopic sleeve gastrectomy. The panel invited 18 bariatric surgeons experienced in laparoscopic gastrectomy from 11 countries to rate the items for inclusion in the curriculum to a predefined level of agreement. Results A consensus of experts was achieved for 24 of the 30 proposed elements for inclusion within the first round of the curriculum Delphi panel. All components pertaining to anatomical knowledge, peri-operative considerations and non-technical items were accepted. A second round further examined six statements, of which three were accepted. Agreement of the panel was reached for 27 of the cognitive, technical and non-technical components after two rounds. Three statements found no consensus. Conclusions Utilizing modified Delphi methodology, a curriculum outlining the most important components of teaching the procedure of laparoscopic sleeve gastrectomy, has been determined by a consensus of international experts in bariatric surgery. The curriculum is suggested as a standard in proficiency-based training of this procedure. It forms a generic template which facilitates individual jurisdictions to perform content validation, adapting the curriculum to local requirements in teaching the next generation of bariatric surgeons. Graphical abstract
- 22 July 2021
- Published by Springer Nature in Obesity Surgery
- Vol. 31 (10) , 4257-4263
Development of an International Standardized Curriculum for Laparoscopic Sleeve Gastrectomy Teaching Utilizing Modified Delphi Methodology
Background The performance of laparoscopic sleeve gastrectomy has increased markedly to become the single-most performed bariatric surgical procedure globally. To date, a means of standardized trainee teaching has not been developed. The aim of this study was to design a laparoscopic curriculum for trainees of bariatric surgery utilizing modified Delphi consensus methodology. Methods A panel of surgeons was assembled to devise an academic framework of technical, non-technical and cognitive skills utilized in the performance of laparoscopic sleeve gastrectomy. The panel invited 18 bariatric surgeons experienced in laparoscopic gastrectomy from 11 countries to rate the items for inclusion in the curriculum to a predefined level of agreement. Results A consensus of experts was achieved for 24 of the 30 proposed elements for inclusion within the first round of the curriculum Delphi panel. All components pertaining to anatomical knowledge, peri-operative considerations and non-technical items were accepted. A second round further examined six statements, of which three were accepted. Agreement of the panel was reached for 27 of the cognitive, technical and non-technical components after two rounds. Three statements found no consensus. Conclusions Utilizing modified Delphi methodology, a curriculum outlining the most important components of teaching the procedure of laparoscopic sleeve gastrectomy, has been determined by a consensus of international experts in bariatric surgery. The curriculum is suggested as a standard in proficiency-based training of this procedure. It forms a generic template which facilitates individual jurisdictions to perform content validation, adapting the curriculum to local requirements in teaching the next generation of bariatric surgeons. Graphical abstract
- Open Access
- 16 March 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (3) , e15443
Implementation of the Operating Room Black Box Research Program at the Ottawa Hospital Through Patient, Clinical, and Organizational Engagement: Case Study
Background: A large proportion of surgical patient harm is preventable; yet, our ability to systematically learn from these incidents and improve clinical practice remains limited. The Operating Room Black Box was developed to address the need for comprehensive assessments of clinical performance in the operating room. It captures synchronized audio, video, patient, and environmental clinical data in real time, which are subsequently analyzed by a combination of expert raters and software-based algorithms. Despite its significant potential to facilitate research and practice improvement, there are many potential implementation challenges at the institutional, clinician, and patient level. This paper summarizes our approach to implementation of the Operating Room Black Box at a large academic Canadian center. Objective: We aimed to contribute to the development of evidence-based best practices for implementing innovative technology in the operating room for direct observation of the clinical performance by using the case of the Operating Room Black Box. Specifically, we outline the systematic approach to the Operating Room Black Box implementation undertaken at our center. Methods: Our implementation approach included seeking support from hospital leadership; building frontline support and a team of champions among patients, nurses, anesthesiologists, and surgeons; accounting for stakeholder perceptions using theory-informed qualitative interviews; engaging patients; and documenting the implementation process, including barriers and facilitators, using the consolidated framework for implementation research. Results: During the 12-month implementation period, we conducted 23 stakeholder engagement activities with over 200 participants. We recruited 10 clinician champions representing nursing, anesthesia, and surgery. We formally interviewed 15 patients and 17 perioperative clinicians and identified key themes to include in an information campaign run as part of the implementation process. Two patient partners were engaged and advised on communications as well as grant and protocol development. Many anticipated and unanticipated challenges were encountered at all levels. Implementation was ultimately successful, with the Operating Room Black Box installed in August 2018, and data collection beginning shortly thereafter. Conclusions: This paper represents the first step toward evidence-guided implementation of technologies for direct observation of performance for research and quality improvement in surgery. With technology increasingly being used in health care settings, the health care community should aim to optimize implementation processes in the best interest of health care professionals and patients.
- 16 March 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (3) , e15443
Open AccessImplementation of the Operating Room Black Box Research Program at the Ottawa Hospital Through Patient, Clinical, and Organizational Engagement: Case Study
Background: A large proportion of surgical patient harm is preventable; yet, our ability to systematically learn from these incidents and improve clinical practice remains limited. The Operating Room Black Box was developed to address the need for comprehensive assessments of clinical performance in the operating room. It captures synchronized audio, video, patient, and environmental clinical data in real time, which are subsequently analyzed by a combination of expert raters and software-based algorithms. Despite its significant potential to facilitate research and practice improvement, there are many potential implementation challenges at the institutional, clinician, and patient level. This paper summarizes our approach to implementation of the Operating Room Black Box at a large academic Canadian center. Objective: We aimed to contribute to the development of evidence-based best practices for implementing innovative technology in the operating room for direct observation of the clinical performance by using the case of the Operating Room Black Box. Specifically, we outline the systematic approach to the Operating Room Black Box implementation undertaken at our center. Methods: Our implementation approach included seeking support from hospital leadership; building frontline support and a team of champions among patients, nurses, anesthesiologists, and surgeons; accounting for stakeholder perceptions using theory-informed qualitative interviews; engaging patients; and documenting the implementation process, including barriers and facilitators, using the consolidated framework for implementation research. Results: During the 12-month implementation period, we conducted 23 stakeholder engagement activities with over 200 participants. We recruited 10 clinician champions representing nursing, anesthesia, and surgery. We formally interviewed 15 patients and 17 perioperative clinicians and identified key themes to include in an information campaign run as part of the implementation process. Two patient partners were engaged and advised on communications as well as grant and protocol development. Many anticipated and unanticipated challenges were encountered at all levels. Implementation was ultimately successful, with the Operating Room Black Box installed in August 2018, and data collection beginning shortly thereafter. Conclusions: This paper represents the first step toward evidence-guided implementation of technologies for direct observation of performance for research and quality improvement in surgery. With technology increasingly being used in health care settings, the health care community should aim to optimize implementation processes in the best interest of health care professionals and patients.
- 1 January 2021
- Published by Elsevier in Journal of Surgical Education
- Vol. 78 (1) , 201-206
Development of the User Experience (UX) and Video Quality Evaluation (VQE) Instruments for Assessment of Intraoperative Video Capture Technology
- 1 January 2021
- Published by Elsevier in Journal of Surgical Education
- Vol. 78 (1) , 201-206
Development of the User Experience (UX) and Video Quality Evaluation (VQE) Instruments for Assessment of Intraoperative Video Capture Technology
- 1 August 2020
- Published by Elsevier in Physica Medica
- Vol. 76, 77-84
Introduction of a surgical Black Box system in a hybrid angiosuite: Challenges and opportunities
- 1 August 2020
- Published by Elsevier in Physica Medica
- Vol. 76, 77-84
Introduction of a surgical Black Box system in a hybrid angiosuite: Challenges and opportunities