Michael A. Scaffidi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Michael A. Scaffidi has a total of 187 co-authors. Here are the top co-authors by number of shared publications:
- Samir Chandra Grover
Department of Medicine, University of Toronto, Toronto, Canada
27 shared publications - Rishad Khan
University of Calgary, Canada
22 shared publications Nikko Gimpaya
Division of Gastroenterology and Hepatology, University of Toronto , Toronto, ON M5S 1A1
12 shared publications- Catharine M. Walsh
Division of Gastroenterology, Hepatology and Nutrition and the SickKids Research and Learning Institutes, The Hospital for Sick Children
10 shared publications Rishad Khan
Division of Gastroenterology and Hepatology, Department of Medicine; University of Calgary; Calgary Canada
10 shared publicationsSamir C. Grover
Department of Medicine, Faculty of Medicine, University of Toronto, Toronto, Canada
10 shared publications
Latest Publications
- 8 September 2025
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 2025 (9) , CD008237
Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy
Background Training in endoscopy has traditionally been based upon an apprenticeship model, where novices develop their skills on real patients under the supervision of experienced endoscopists. In an effort to prioritise patient safety, simulation training has emerged as a means to allow novices to practice in a risk‐free environment. This is the second update of the review, which was first published in 2012 and updated in 2018. It evaluates the effectiveness of virtual reality (VR) simulation training in gastrointestinal endoscopy. Objectives To determine whether VR simulation training can supplement and/or replace early conventional endoscopy training (apprenticeship model) in diagnostic oesophagogastroduodenoscopy, colonoscopy, and/or sigmoidoscopy for health professions trainees with limited or no prior endoscopic experience. Search methods We searched CENTRAL, MEDLINE, Embase, and 13 other databases, together with reference checking and handsearching of review articles, conference abstracts and proceedings, to identify the studies included in the review. We conducted database searches to 18 October 2023, and grey literature searches to December 2023. Selection criteria We included randomised and quasi‐randomised clinical trials comparing VR endoscopy simulation training to any other method of endoscopy training (e.g. conventional patient‐based training, another form of endoscopy simulation), or no training. We also included trials comparing two different methods of VR training. We included only trials evaluating outcomes on humans in the clinical setting. Participants were health professions trainees: physicians (medical students, residents, fellows, and practitioners), nurses, and physician assistants with limited or no prior endoscopy experience. Data collection and analysis Two authors independently assessed the eligibility and methodological quality of trials, and extracted trial characteristics and outcome data. The primary outcome was the composite score of competency, as defined by authors. Secondary outcomes were independent procedure completion, performance time, adverse event or critical flaw occurrence, patient discomfort, global rating of performance, and visualisation of mucosa. We pooled data for meta‐analysis where participant groups were similar, studies assessed the same intervention and comparator, and had similar definitions of outcome measures. We calculated risk ratios (RRs) for dichotomous outcomes with 95% confidence intervals (CIs). We calculated mean differences (MDs) and standardised mean differences (SMDs) with 95% CIs for continuous outcomes when studies reported the same or different outcome measures, respectively. We used GRADE to rate the certainty of evidence. We assessed the risk of bias using the original Cochrane domain‐based tool. Main results We included 20 trials (500 participants; 3975 endoscopic procedures). We judged four trials (20%) as at low risk of bias. Ten trials compared VR training with no training, five trials with conventional endoscopy training, one trial with another form of endoscopy simulation training, and four trials compared different methods of VR training. Due to substantial clinical and methodological heterogeneity across our four comparisons, we did not perform a meta‐analysis for several outcomes. We rated the certainty of evidence as moderate, low, or very low due to risk of bias, imprecision, and heterogeneity. VR endoscopy simulation training versus no training. The composite score of competency was based on 5‐point Likert scales assessing seven domains: atraumatic technique, colonoscope advancement, use of instrument controls, flow of procedure, use of assistants, knowledge of specific procedure, and overall performance. The scoring range was from 7 to 35; higher scores mean greater competence. Compared to no training, VR training may result in little to no difference in composite score of competency (MD 3.10, 95% CI ‐0.16 to 6.36; 1 trial, 24 procedures; low‐certainty evidence). VR training likely provides participants with a benefit, as measured by independent procedure completion (RR 1.62, 95% CI 1.15 to 2.26; 6 trials, 815 procedures; moderate‐certainty evidence). The evidence is very uncertain about the effects of VR simulation on overall rating of performance (MD 0.45, 95% CI 0.15 to 0.75; 1 trial, 18 procedures), visualisation of mucosa (MD 0.60, 95% CI 0.20 to 1.00; 1 trial, 55 procedures), performance time (MD ‐0.20 minutes, 95% CI ‐0.71 to 0.30; 2 trials, 29 procedures), and patient discomfort (SMD ‐0.16, 95% CI ‐0.68 to 0.35; 2 trials, 145 procedures). The three trials which reported on procedure‐related adverse events or critical flaws reported no incidences in either group (550 procedures; moderate‐certainty evidence). VR endoscopy simulation training versus conventional patient‐based training. One trial reported a composite score of competency but did not provide sufficient data for quantitative analysis. VR training compared to conventional patient‐based training may result in fewer independent procedure completions (RR 0.45, 95% CI 0.27 to 0.74; 2 trials, 174 procedures; low‐certainty evidence). The evidence is very uncertain about the effects of VR simulation on performance time (SMD 0.12, 95% CI ‐0.55 to 0.80; 2 trials, 34 procedures), overall rating of performance (MD ‐0.90, 95% CI ‐4.40 to 2.60; 1 trial, 16 procedures), and visualisation of mucosa (MD 0.0, 95% CI ‐6.02 to 6.02; 1 trial, 18 procedures). VR training in combination with conventional training appears to be advantageous over VR training alone. The three trials which reported on procedure‐related adverse events or critical flaws reported no incidences in either group (72 procedures; very low‐certainty evidence). Authors' conclusions Despite moderate‐ to very low‐certainty...
- 8 September 2025
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 2025 (9) , CD008237
Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy
Background Training in endoscopy has traditionally been based upon an apprenticeship model, where novices develop their skills on real patients under the supervision of experienced endoscopists. In an effort to prioritise patient safety, simulation training has emerged as a means to allow novices to practice in a risk‐free environment. This is the second update of the review, which was first published in 2012 and updated in 2018. It evaluates the effectiveness of virtual reality (VR) simulation training in gastrointestinal endoscopy. Objectives To determine whether VR simulation training can supplement and/or replace early conventional endoscopy training (apprenticeship model) in diagnostic oesophagogastroduodenoscopy, colonoscopy, and/or sigmoidoscopy for health professions trainees with limited or no prior endoscopic experience. Search methods We searched CENTRAL, MEDLINE, Embase, and 13 other databases, together with reference checking and handsearching of review articles, conference abstracts and proceedings, to identify the studies included in the review. We conducted database searches to 18 October 2023, and grey literature searches to December 2023. Selection criteria We included randomised and quasi‐randomised clinical trials comparing VR endoscopy simulation training to any other method of endoscopy training (e.g. conventional patient‐based training, another form of endoscopy simulation), or no training. We also included trials comparing two different methods of VR training. We included only trials evaluating outcomes on humans in the clinical setting. Participants were health professions trainees: physicians (medical students, residents, fellows, and practitioners), nurses, and physician assistants with limited or no prior endoscopy experience. Data collection and analysis Two authors independently assessed the eligibility and methodological quality of trials, and extracted trial characteristics and outcome data. The primary outcome was the composite score of competency, as defined by authors. Secondary outcomes were independent procedure completion, performance time, adverse event or critical flaw occurrence, patient discomfort, global rating of performance, and visualisation of mucosa. We pooled data for meta‐analysis where participant groups were similar, studies assessed the same intervention and comparator, and had similar definitions of outcome measures. We calculated risk ratios (RRs) for dichotomous outcomes with 95% confidence intervals (CIs). We calculated mean differences (MDs) and standardised mean differences (SMDs) with 95% CIs for continuous outcomes when studies reported the same or different outcome measures, respectively. We used GRADE to rate the certainty of evidence. We assessed the risk of bias using the original Cochrane domain‐based tool. Main results We included 20 trials (500 participants; 3975 endoscopic procedures). We judged four trials (20%) as at low risk of bias. Ten trials compared VR training with no training, five trials with conventional endoscopy training, one trial with another form of endoscopy simulation training, and four trials compared different methods of VR training. Due to substantial clinical and methodological heterogeneity across our four comparisons, we did not perform a meta‐analysis for several outcomes. We rated the certainty of evidence as moderate, low, or very low due to risk of bias, imprecision, and heterogeneity. VR endoscopy simulation training versus no training. The composite score of competency was based on 5‐point Likert scales assessing seven domains: atraumatic technique, colonoscope advancement, use of instrument controls, flow of procedure, use of assistants, knowledge of specific procedure, and overall performance. The scoring range was from 7 to 35; higher scores mean greater competence. Compared to no training, VR training may result in little to no difference in composite score of competency (MD 3.10, 95% CI ‐0.16 to 6.36; 1 trial, 24 procedures; low‐certainty evidence). VR training likely provides participants with a benefit, as measured by independent procedure completion (RR 1.62, 95% CI 1.15 to 2.26; 6 trials, 815 procedures; moderate‐certainty evidence). The evidence is very uncertain about the effects of VR simulation on overall rating of performance (MD 0.45, 95% CI 0.15 to 0.75; 1 trial, 18 procedures), visualisation of mucosa (MD 0.60, 95% CI 0.20 to 1.00; 1 trial, 55 procedures), performance time (MD ‐0.20 minutes, 95% CI ‐0.71 to 0.30; 2 trials, 29 procedures), and patient discomfort (SMD ‐0.16, 95% CI ‐0.68 to 0.35; 2 trials, 145 procedures). The three trials which reported on procedure‐related adverse events or critical flaws reported no incidences in either group (550 procedures; moderate‐certainty evidence). VR endoscopy simulation training versus conventional patient‐based training. One trial reported a composite score of competency but did not provide sufficient data for quantitative analysis. VR training compared to conventional patient‐based training may result in fewer independent procedure completions (RR 0.45, 95% CI 0.27 to 0.74; 2 trials, 174 procedures; low‐certainty evidence). The evidence is very uncertain about the effects of VR simulation on performance time (SMD 0.12, 95% CI ‐0.55 to 0.80; 2 trials, 34 procedures), overall rating of performance (MD ‐0.90, 95% CI ‐4.40 to 2.60; 1 trial, 16 procedures), and visualisation of mucosa (MD 0.0, 95% CI ‐6.02 to 6.02; 1 trial, 18 procedures). VR training in combination with conventional training appears to be advantageous over VR training alone. The three trials which reported on procedure‐related adverse events or critical flaws reported no incidences in either group (72 procedures; very low‐certainty evidence). Authors' conclusions Despite moderate‐ to very low‐certainty...
- Open Access
- 26 June 2025
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 8 (4) , 136-141
Factors affecting technical success of endoscopic retrograde cholangiopancreatographic outcomes in patients with surgically altered foregut anatomy: a retrospective study
Introduction: Patients with surgically altered gastrointestinal anatomy undergoing endoscopic retrograde cholangiopancreatography (ERCP) pose challenges due to anatomical distortions. Various patient and endoscopic factors, such as sex and positioning, may impact procedural success. It is unclear how these factors may impact the technical success of ERCP among patients with altered anatomy. Objective: We aimed to determine the patient and endoscopic factors that were associated with technical success of ERCP. Methods: We conducted a retrospective single-centre study using data from 2010 to 2020 that included patients with hepaticojejunostomy, Roux-en-Y anastomosis, Billroth-1, or Billroth-2 anatomy at a single tertiary care centre in Toronto, Canada. We extracted data from a database. The primary outcome was technical success of the ERCP, defined as successful navigation to the papilla or surgical anastomosis, selective cannulation and cholangiography or pancreatography. Penalized logistic regression with elastic net regularization was used to identify significant predictors of technical success. Effect size was odds ratio with 95% confidence interval. The model was evaluated using the area under the curve (AUC) metric. Results: Overall, there were 205 patients included in the analysis. In the multivariate analysis, the most significant contributors to predicting technical success of ERCP were expert endoscopic experience and non-Roux-en Y anatomy. The elastic net model demonstrated moderate predictive performance, with an AUC of 0.656. Conclusions: The findings emphasize the importance of tailored procedural planning to optimize ERCP success in patients with altered anatomy.
- 26 June 2025
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 8 (4) , 136-141
Open AccessFactors affecting technical success of endoscopic retrograde cholangiopancreatographic outcomes in patients with surgically altered foregut anatomy: a retrospective study
Introduction: Patients with surgically altered gastrointestinal anatomy undergoing endoscopic retrograde cholangiopancreatography (ERCP) pose challenges due to anatomical distortions. Various patient and endoscopic factors, such as sex and positioning, may impact procedural success. It is unclear how these factors may impact the technical success of ERCP among patients with altered anatomy. Objective: We aimed to determine the patient and endoscopic factors that were associated with technical success of ERCP. Methods: We conducted a retrospective single-centre study using data from 2010 to 2020 that included patients with hepaticojejunostomy, Roux-en-Y anastomosis, Billroth-1, or Billroth-2 anatomy at a single tertiary care centre in Toronto, Canada. We extracted data from a database. The primary outcome was technical success of the ERCP, defined as successful navigation to the papilla or surgical anastomosis, selective cannulation and cholangiography or pancreatography. Penalized logistic regression with elastic net regularization was used to identify significant predictors of technical success. Effect size was odds ratio with 95% confidence interval. The model was evaluated using the area under the curve (AUC) metric. Results: Overall, there were 205 patients included in the analysis. In the multivariate analysis, the most significant contributors to predicting technical success of ERCP were expert endoscopic experience and non-Roux-en Y anatomy. The elastic net model demonstrated moderate predictive performance, with an AUC of 0.656. Conclusions: The findings emphasize the importance of tailored procedural planning to optimize ERCP success in patients with altered anatomy.
- Open Access
- 3 April 2025
- Published by Elsevier in Gastroenterology
- Vol. 169 (6) , 1112-1115
A Learner’s Guide to Optical Diagnosis in Endoscopy: Training Strategies and Practical Applications
- 3 April 2025
- Published by Elsevier in Gastroenterology
- Vol. 169 (6) , 1112-1115
Open AccessA Learner’s Guide to Optical Diagnosis in Endoscopy: Training Strategies and Practical Applications
- Open Access
- 2 December 2024
- Published by Georg Thieme Verlag KG in Endoscopy International Open
- Vol. 13 (CP) , a24947333
On-site ERCP availability and cholangitis outcomes: Retrospective cohort study
Endoscopic retrograde cholangiopancreatography (ERCP) is important in acute cholangitis (AC) management but is not available at all hospitals. The association between on-site ERCP availability and cholangitis outcomes is unknown.We included adults diagnosed with AC at 27 hospitals in Ontario through the GEMINI network. We collected data on demographics, clinical and laboratory values, and interventions. The primary outcome was in-hospital mortality. Secondary outcomes were length of stay, intensive care unit (ICU) admission, readmission rates, and requirement for percutaneous or surgical decompression. We used multivariable regression analyses to assess the impact of on-site ERCP availability on the primary and secondary outcomes with adjustment for relevant variables.Our cohort included 4492 patients with a median age of 75. Patients at ERCP sites had higher unadjusted rates of undergoing ERCP (55.7% at ERCP sites, 40.8% at non-ERCP sites). Patients at ERCP sites compared with non-ERCP sites did not have significantly different in-hospital mortality (adjusted odds ratio [aOR] = 2.19, 95% confidence interval [CI] = 0.86–5.55). Compared with non-ERCP sites, patients at ERCP sites with underlying stricturing biliary disease or pancreaticobiliary malignancy (aOR = 1.94, 95% CI = 1.14–13.58) or severe cholangitis (aOR = 2.17, 95% CI = 1.17–4.02) had higher odds of in-hospital mortality. In a post-hoc propensity score-based analysis, there was no significant difference between patients at ERCP sites compared with those at non-ERCP sites for in-hospital mortality.Patients at ERCP sites compared with non-ERCP sites did not have significantly different mortality. Subgroups of patients with underlying stricturing biliary disease or pancreaticobiliary malignancy and severe cholangitis, who have higher mortality at ERCP sites, warrant further study.
- 2 December 2024
- Published by Georg Thieme Verlag KG in Endoscopy International Open
- Vol. 13 (CP) , a24947333
Open AccessOn-site ERCP availability and cholangitis outcomes: Retrospective cohort study
Endoscopic retrograde cholangiopancreatography (ERCP) is important in acute cholangitis (AC) management but is not available at all hospitals. The association between on-site ERCP availability and cholangitis outcomes is unknown.We included adults diagnosed with AC at 27 hospitals in Ontario through the GEMINI network. We collected data on demographics, clinical and laboratory values, and interventions. The primary outcome was in-hospital mortality. Secondary outcomes were length of stay, intensive care unit (ICU) admission, readmission rates, and requirement for percutaneous or surgical decompression. We used multivariable regression analyses to assess the impact of on-site ERCP availability on the primary and secondary outcomes with adjustment for relevant variables.Our cohort included 4492 patients with a median age of 75. Patients at ERCP sites had higher unadjusted rates of undergoing ERCP (55.7% at ERCP sites, 40.8% at non-ERCP sites). Patients at ERCP sites compared with non-ERCP sites did not have significantly different in-hospital mortality (adjusted odds ratio [aOR] = 2.19, 95% confidence interval [CI] = 0.86–5.55). Compared with non-ERCP sites, patients at ERCP sites with underlying stricturing biliary disease or pancreaticobiliary malignancy (aOR = 1.94, 95% CI = 1.14–13.58) or severe cholangitis (aOR = 2.17, 95% CI = 1.17–4.02) had higher odds of in-hospital mortality. In a post-hoc propensity score-based analysis, there was no significant difference between patients at ERCP sites compared with those at non-ERCP sites for in-hospital mortality.Patients at ERCP sites compared with non-ERCP sites did not have significantly different mortality. Subgroups of patients with underlying stricturing biliary disease or pancreaticobiliary malignancy and severe cholangitis, who have higher mortality at ERCP sites, warrant further study.
- Open Access
- 14 December 2023
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 7 (2) , 137-148
Patient and Public Involvement in Inflammatory Bowel Disease Research—A Scoping Review
Background: Interest in patient and public involvement in research has grown. Medical, health, and social care research has demonstrated several benefits of patient and public engagement, such as empowering user input and reducing attrition rates in clinical trials. To date, no study has reviewed patient engagement in inflammatory bowel disease (IBD). We aimed to describe the benefits, challenges, and best practices of patient engagement in IBD research. Methods: We performed a systematic search on MEDLINE, EMBASE, and Cochrane for all clinical IBD research studies in which patients were involved in the research process (1946- 2023). Patient input was considered in: (1) study design, (2) study execution, (3) research dissemination, and/or (4) other domains not specified here. Two authors independently screened and extracted data on type of engaged person(s), format of engagement, author-reported benefits, recommendations, and challenges. For each study, we reported the level of patient engagement and study adherence to standardized reporting guidelines. Results: After screening 9,355 articles, we included 51 for final analysis. IBD patients were most frequently engaged in study design. Patient engagement in IBD research improved recruitment rates and promoted the creation of user-friendly quality-of-life tools. Selection bias and recruitment difficulties were common challenges in the application of patient engagement. Authors recommended continuous patient involvement to address emerging priorities and cognitive interviewing to improve questionnaire clarity. Conclusions: Patient engagement represents an important step in promoting patient-centred care. According to study authors, implementing cognitive interviewing techniques, continuous patient involvement, and standardized reporting guidelines may improve future iterations of engagement in IBD.
- 14 December 2023
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 7 (2) , 137-148
Open AccessPatient and Public Involvement in Inflammatory Bowel Disease Research—A Scoping Review
Background: Interest in patient and public involvement in research has grown. Medical, health, and social care research has demonstrated several benefits of patient and public engagement, such as empowering user input and reducing attrition rates in clinical trials. To date, no study has reviewed patient engagement in inflammatory bowel disease (IBD). We aimed to describe the benefits, challenges, and best practices of patient engagement in IBD research. Methods: We performed a systematic search on MEDLINE, EMBASE, and Cochrane for all clinical IBD research studies in which patients were involved in the research process (1946- 2023). Patient input was considered in: (1) study design, (2) study execution, (3) research dissemination, and/or (4) other domains not specified here. Two authors independently screened and extracted data on type of engaged person(s), format of engagement, author-reported benefits, recommendations, and challenges. For each study, we reported the level of patient engagement and study adherence to standardized reporting guidelines. Results: After screening 9,355 articles, we included 51 for final analysis. IBD patients were most frequently engaged in study design. Patient engagement in IBD research improved recruitment rates and promoted the creation of user-friendly quality-of-life tools. Selection bias and recruitment difficulties were common challenges in the application of patient engagement. Authors recommended continuous patient involvement to address emerging priorities and cognitive interviewing to improve questionnaire clarity. Conclusions: Patient engagement represents an important step in promoting patient-centred care. According to study authors, implementing cognitive interviewing techniques, continuous patient involvement, and standardized reporting guidelines may improve future iterations of engagement in IBD.
- Open Access
- 10 October 2023
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 6 (6) , 212-218
Interobserver Reliability of the Paris Classification for Superficial Gastrointestinal Tract Neoplasms: A Systematic Review
Background and study aims: The Paris classification characterizes the morphology of superficial gastrointestinal tract neoplasms. This system has been shown to predict the risk of submucosal invasion in certain subtypes of lesions. There is limited data that assesses its agreement amongst endoscopists. We performed a systematic review to summarize the available literature on the interobserver reliability (IOR) of the Paris classification. Methods: We conducted a search through December 2020 for studies reporting IOR of the Paris classification. Studies were included if they quantitatively evaluated the IOR of the Paris classification with at least five participating endoscopists. Two authors independently screened studies and abstracted data using an a priori-designed data collection form. Evaluation of study quality and risk of bias was performed using an adapted version of the Guidelines for Reporting Reliability and Agreement Studies. Results: Of the 1,541 studies retrieved, 5 were included in the review. All studies were observational cohort studies published between 2014 and 2020. The IOR of the Paris classification was moderate amongst all four studies evaluating colorectal neoplasms (range, κ = 0.42 to κ = 0.54) and substantial in one study that evaluated gastric neoplasms (κw = 0.65). An educational intervention was conducted by three studies with variable methodology and no significant change in IOR. Conclusions: IOR of the Paris classification is moderate for superficial colonic neoplasms. Further study is needed to determine the reliability of this system for superficial gastric lesions. Standardized training programs are required to investigate the impact of educational intervention on the Paris classification amongst endoscopists.
- 10 October 2023
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 6 (6) , 212-218
Open AccessInterobserver Reliability of the Paris Classification for Superficial Gastrointestinal Tract Neoplasms: A Systematic Review
Background and study aims: The Paris classification characterizes the morphology of superficial gastrointestinal tract neoplasms. This system has been shown to predict the risk of submucosal invasion in certain subtypes of lesions. There is limited data that assesses its agreement amongst endoscopists. We performed a systematic review to summarize the available literature on the interobserver reliability (IOR) of the Paris classification. Methods: We conducted a search through December 2020 for studies reporting IOR of the Paris classification. Studies were included if they quantitatively evaluated the IOR of the Paris classification with at least five participating endoscopists. Two authors independently screened studies and abstracted data using an a priori-designed data collection form. Evaluation of study quality and risk of bias was performed using an adapted version of the Guidelines for Reporting Reliability and Agreement Studies. Results: Of the 1,541 studies retrieved, 5 were included in the review. All studies were observational cohort studies published between 2014 and 2020. The IOR of the Paris classification was moderate amongst all four studies evaluating colorectal neoplasms (range, κ = 0.42 to κ = 0.54) and substantial in one study that evaluated gastric neoplasms (κw = 0.65). An educational intervention was conducted by three studies with variable methodology and no significant change in IOR. Conclusions: IOR of the Paris classification is moderate for superficial colonic neoplasms. Further study is needed to determine the reliability of this system for superficial gastric lesions. Standardized training programs are required to investigate the impact of educational intervention on the Paris classification amongst endoscopists.
- Open Access
- 13 July 2023
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 18 (7) , e0288474
Video-based interventions to improve self-assessment accuracy among physicians: A systematic review
Purpose: Self-assessment of a physician’s performance in both procedure and non-procedural activities can be used to identify their deficiencies to allow for appropriate corrective measures. Physicians are inaccurate in their self-assessments, which may compromise opportunities for self- development. To improve this accuracy, video-based interventions of physicians watching their own performance, an experts’ performance or both, have been proposed to inform their self-assessment. We conducted a systematic review of the effectiveness of video-based interventions targeting improved self-assessment accuracy among physicians. Materials and methods: The authors performed a systematic search of MEDLINE, Embase, EBM reviews, and Scopus databases from inception to August 23, 2022, using combinations of terms for “self-assessment”, “video-recording”, and “physician”. Eligible studies were empirical investigations assessing the effect of video-based interventions on physicians’ self-assessment accuracy with a comparison of self-assessment accuracy pre- and post- video intervention. We defined self-assessment accuracy as a “direct comparison between an external evaluator and self-assessment that was quantified using formal statistical analysis”. Two reviewers independently screened records, extracted data, assessed risk of bias, and evaluated quality of evidence. A narrative synthesis was conducted, as variable outcomes precluded a meta-analysis. Results: A total of 2,376 papers were initially retrieved. Of these, 22 papers were selected for full-text review; a final 9 studies met inclusion criteria for data extraction. Across studies, 240 participants from 5 specialties were represented. Video-based interventions included self-video review (8/9), benchmark video review (3/9), and/or a combination of both types (1/9). Five out of nine studies reported that participants had inaccurate self-assessment at baseline. After the intervention, 5 of 9 studies found a statistically significant improvement in self-assessment accuracy. Conclusions: Overall, current data suggests video-based interventions can improve self-assessment accuracy. Benchmark video review may enable physicians to improve self-assessment accuracy, especially for those with limited experience performing a particular clinical skill. In contrast, self-video review may be able to provide improvement in self-assessment accuracy for more experience physicians. Future research should use standardized methods of comparison for self-assessment accuracy, such as the Bland-Altman analysis, to facilitate meta-analytic summation.
- 13 July 2023
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 18 (7) , e0288474
Open AccessVideo-based interventions to improve self-assessment accuracy among physicians: A systematic review
Purpose: Self-assessment of a physician’s performance in both procedure and non-procedural activities can be used to identify their deficiencies to allow for appropriate corrective measures. Physicians are inaccurate in their self-assessments, which may compromise opportunities for self- development. To improve this accuracy, video-based interventions of physicians watching their own performance, an experts’ performance or both, have been proposed to inform their self-assessment. We conducted a systematic review of the effectiveness of video-based interventions targeting improved self-assessment accuracy among physicians. Materials and methods: The authors performed a systematic search of MEDLINE, Embase, EBM reviews, and Scopus databases from inception to August 23, 2022, using combinations of terms for “self-assessment”, “video-recording”, and “physician”. Eligible studies were empirical investigations assessing the effect of video-based interventions on physicians’ self-assessment accuracy with a comparison of self-assessment accuracy pre- and post- video intervention. We defined self-assessment accuracy as a “direct comparison between an external evaluator and self-assessment that was quantified using formal statistical analysis”. Two reviewers independently screened records, extracted data, assessed risk of bias, and evaluated quality of evidence. A narrative synthesis was conducted, as variable outcomes precluded a meta-analysis. Results: A total of 2,376 papers were initially retrieved. Of these, 22 papers were selected for full-text review; a final 9 studies met inclusion criteria for data extraction. Across studies, 240 participants from 5 specialties were represented. Video-based interventions included self-video review (8/9), benchmark video review (3/9), and/or a combination of both types (1/9). Five out of nine studies reported that participants had inaccurate self-assessment at baseline. After the intervention, 5 of 9 studies found a statistically significant improvement in self-assessment accuracy. Conclusions: Overall, current data suggests video-based interventions can improve self-assessment accuracy. Benchmark video review may enable physicians to improve self-assessment accuracy, especially for those with limited experience performing a particular clinical skill. In contrast, self-video review may be able to provide improvement in self-assessment accuracy for more experience physicians. Future research should use standardized methods of comparison for self-assessment accuracy, such as the Bland-Altman analysis, to facilitate meta-analytic summation.
- 23 February 2023
- Published by Georg Thieme Verlag KG in Endoscopy
- Vol. 55 (09) , 847-856
Validity evidence for observational ERCP competency assessment tools: a systematic review
Background Assessment of competence in endoscopic retrograde cholangiopancreatography (ERCP) is critical for supporting learning and documenting attainment of skill. Validity evidence supporting ERCP observational assessment tools has not been systematically evaluated. Methods We conducted a systematic search using electronic databases and hand-searching from inception until August 2021 for studies evaluating observational assessment tools of ERCP performance. We used a unified validity framework to characterize validity evidence from five sources: content, response process, internal structure, relations to other variables, and consequences. Each domain was assigned a score of 0–3 (maximum score 15). We assessed educational utility and methodological quality using the Accreditation Council for Graduate Medical Education framework and the Medical Education Research Quality Instrument, respectively. Results From 2769 records, we included 17 studies evaluating 7 assessment tools. Five tools were studied for clinical ERCP, one for simulated ERCP, and one for simulated and clinical ERCP. Validity evidence scores ranged from 2 to 12. The Bethesda ERCP Skills Assessment Tool (BESAT), ERCP Direct Observation of Procedural Skills Tool (ERCP DOPS), and The Endoscopic Ultrasound (EUS) and ERCP Skills Assessment Tool (TEESAT) had the strongest validity evidence, with scores of 10, 12, and 11, respectively. Regarding educational utility, most tools were easy to use and interpret, and required minimal additional resources. Overall methodological quality (maximum score 13.5) was strong, with scores ranging from 10 to 12.5. Conclusions The BESAT, ERCP DOPS, and TEESAT had strong validity evidence compared with other assessments. Integrating tools into training may help drive learners’ development and support competency decision making.
- 23 February 2023
- Published by Georg Thieme Verlag KG in Endoscopy
- Vol. 55 (09) , 847-856
Validity evidence for observational ERCP competency assessment tools: a systematic review
Background Assessment of competence in endoscopic retrograde cholangiopancreatography (ERCP) is critical for supporting learning and documenting attainment of skill. Validity evidence supporting ERCP observational assessment tools has not been systematically evaluated. Methods We conducted a systematic search using electronic databases and hand-searching from inception until August 2021 for studies evaluating observational assessment tools of ERCP performance. We used a unified validity framework to characterize validity evidence from five sources: content, response process, internal structure, relations to other variables, and consequences. Each domain was assigned a score of 0–3 (maximum score 15). We assessed educational utility and methodological quality using the Accreditation Council for Graduate Medical Education framework and the Medical Education Research Quality Instrument, respectively. Results From 2769 records, we included 17 studies evaluating 7 assessment tools. Five tools were studied for clinical ERCP, one for simulated ERCP, and one for simulated and clinical ERCP. Validity evidence scores ranged from 2 to 12. The Bethesda ERCP Skills Assessment Tool (BESAT), ERCP Direct Observation of Procedural Skills Tool (ERCP DOPS), and The Endoscopic Ultrasound (EUS) and ERCP Skills Assessment Tool (TEESAT) had the strongest validity evidence, with scores of 10, 12, and 11, respectively. Regarding educational utility, most tools were easy to use and interpret, and required minimal additional resources. Overall methodological quality (maximum score 13.5) was strong, with scores ranging from 10 to 12.5. Conclusions The BESAT, ERCP DOPS, and TEESAT had strong validity evidence compared with other assessments. Integrating tools into training may help drive learners’ development and support competency decision making.
- 26 September 2022
- Published by Georg Thieme Verlag KG in Endoscopy
- Vol. 55 (02) , 176-185
Accuracy of self-assessment in gastrointestinal endoscopy: a systematic review and meta-analysis
Background Assessment is necessary to ensure both attainment and maintenance of competency in gastrointestinal (GI) endoscopy, and this can be accomplished through self-assessment. We conducted a systematic review with meta-analysis to evaluate the accuracy of self-assessment among GI endoscopists. Methods This was an individual participant data meta-analysis of studies that investigated self-assessment of endoscopic competency. We performed a systematic search of the following databases: Ovid MEDLINE, Ovid EMBASE, Wiley Cochrane CENTRAL, and ProQuest Education Resources Information Center. We included studies if they were primary investigations of self-assessment accuracy in GI endoscopy that used statistical analyses to determine accuracy. We conducted a meta-analysis of studies using a limits of agreement (LoA) approach to meta-analysis of Bland–Altman studies. Results After removing duplicate entries, we screened 7138 records. After full-text review, we included 16 studies for qualitative analysis and three for meta-analysis. In the meta-analysis, we found that the LoA were wide (−41.0 % to 34.0 %) and beyond the clinically acceptable difference. Subgroup analyses found that both novice and intermediate endoscopists had wide LoA (−45.0 % to 35.1 % and −54.7 % to 46.5 %, respectively) and expert endoscopists had narrow LoA (−14.2 % to 21.4 %). Conclusions GI endoscopists are inaccurate in self-assessment of their endoscopic competency. Subgroup analyses demonstrated that novice and intermediate endoscopists were inaccurate, while expert endoscopists have accurate self-assessment. While we advise against the sole use of self-assessment among novice and intermediate endoscopists, expert endoscopists may wish to integrate it into their practice. * Equal first authors Received: 06 November 2021 Accepted after revision: 20 June 2022 Article published online: 26 September 2022 © 2022. Thieme. All rights reserved. Georg Thieme Verlag KG Rüdigerstraße 14, 70469 Stuttgart, Germany
- 26 September 2022
- Published by Georg Thieme Verlag KG in Endoscopy
- Vol. 55 (02) , 176-185
Accuracy of self-assessment in gastrointestinal endoscopy: a systematic review and meta-analysis
Background Assessment is necessary to ensure both attainment and maintenance of competency in gastrointestinal (GI) endoscopy, and this can be accomplished through self-assessment. We conducted a systematic review with meta-analysis to evaluate the accuracy of self-assessment among GI endoscopists. Methods This was an individual participant data meta-analysis of studies that investigated self-assessment of endoscopic competency. We performed a systematic search of the following databases: Ovid MEDLINE, Ovid EMBASE, Wiley Cochrane CENTRAL, and ProQuest Education Resources Information Center. We included studies if they were primary investigations of self-assessment accuracy in GI endoscopy that used statistical analyses to determine accuracy. We conducted a meta-analysis of studies using a limits of agreement (LoA) approach to meta-analysis of Bland–Altman studies. Results After removing duplicate entries, we screened 7138 records. After full-text review, we included 16 studies for qualitative analysis and three for meta-analysis. In the meta-analysis, we found that the LoA were wide (−41.0 % to 34.0 %) and beyond the clinically acceptable difference. Subgroup analyses found that both novice and intermediate endoscopists had wide LoA (−45.0 % to 35.1 % and −54.7 % to 46.5 %, respectively) and expert endoscopists had narrow LoA (−14.2 % to 21.4 %). Conclusions GI endoscopists are inaccurate in self-assessment of their endoscopic competency. Subgroup analyses demonstrated that novice and intermediate endoscopists were inaccurate, while expert endoscopists have accurate self-assessment. While we advise against the sole use of self-assessment among novice and intermediate endoscopists, expert endoscopists may wish to integrate it into their practice. * Equal first authors Received: 06 November 2021 Accepted after revision: 20 June 2022 Article published online: 26 September 2022 © 2022. Thieme. All rights reserved. Georg Thieme Verlag KG Rüdigerstraße 14, 70469 Stuttgart, Germany
- Open Access
- 1 June 2022
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 5 (5) , 214-220
Financial Conflicts of Interest in Propensity Score-Matched Studies Evaluating Biologics and Biosimilars for Inflammatory Bowel Disease
Propensity score matching (PSM), a statistical technique that estimates a treatment effect by accounting for predictor covariates, has been used to evaluate biologics for inflammatory bowel disease (IBD). Financial conflicts of interest are prevalent in the marketing of biologic medications. It is unclear whether this burden of conflicts is present among authors of PSM studies comparing IBD biologics and biosimilars. This study was aimed to determine the prevalence of financial conflicts of interest among authors of PSM studies evaluating IBD biologics and biosimilars. We conducted a systematic search for PSM studies comparing biologics and biosimilars in IBD treatment. We identified 21 eligible studies. Two independent authors extracted self-declared conflicts from the disclosures section. Each participating author was searched on the Centers for Medicare & Medicaid Services Open Payments to identify payment amounts and undisclosed conflicts. Primary outcome was the prevalence of author conflicts. Secondary analyses assessed for an association between conflict prevalence and reporting of positive outcomes. Among 283 authors, conflicts were present among 41.0% (116 of 283). Twenty-three per cent (27 of 116) of author conflicts involved undisclosed payments. Studies with positive outcomes were significantly more likely to include conflicted authors than neutral studies (relative risk = 2.34, 95% confidence interval: 1.71 to 3.21, P < 0.001). Overall, we found a high burden of undisclosed conflicts among authors of PSM studies comparing IBD biologics and biosimilars. Given the importance of PSM studies as a means for biologic comparison and the potential for undue industry influence from these payments, authors should ensure greater transparency with reporting of industry relationships.
- 1 June 2022
- Published by Oxford University Press (OUP) in Journal of the Canadian Association of Gastroenterology
- Vol. 5 (5) , 214-220
Open AccessFinancial Conflicts of Interest in Propensity Score-Matched Studies Evaluating Biologics and Biosimilars for Inflammatory Bowel Disease
Propensity score matching (PSM), a statistical technique that estimates a treatment effect by accounting for predictor covariates, has been used to evaluate biologics for inflammatory bowel disease (IBD). Financial conflicts of interest are prevalent in the marketing of biologic medications. It is unclear whether this burden of conflicts is present among authors of PSM studies comparing IBD biologics and biosimilars. This study was aimed to determine the prevalence of financial conflicts of interest among authors of PSM studies evaluating IBD biologics and biosimilars. We conducted a systematic search for PSM studies comparing biologics and biosimilars in IBD treatment. We identified 21 eligible studies. Two independent authors extracted self-declared conflicts from the disclosures section. Each participating author was searched on the Centers for Medicare & Medicaid Services Open Payments to identify payment amounts and undisclosed conflicts. Primary outcome was the prevalence of author conflicts. Secondary analyses assessed for an association between conflict prevalence and reporting of positive outcomes. Among 283 authors, conflicts were present among 41.0% (116 of 283). Twenty-three per cent (27 of 116) of author conflicts involved undisclosed payments. Studies with positive outcomes were significantly more likely to include conflicted authors than neutral studies (relative risk = 2.34, 95% confidence interval: 1.71 to 3.21, P < 0.001). Overall, we found a high burden of undisclosed conflicts among authors of PSM studies comparing IBD biologics and biosimilars. Given the importance of PSM studies as a means for biologic comparison and the potential for undue industry influence from these payments, authors should ensure greater transparency with reporting of industry relationships.