Artificial Intelligence-Guided Bronchoscopy is Superior to Human Expert Instruction for the Performance of Critical-Care Physicians: A Randomized Controlled Trial
Top Cited Papers
Open Access
- 20 March 2025
- journal article
- research article
- Published by Wolters Kluwer Health in Critical Care Medicine
- Vol. 53 (5) , e1105-e1115
Abstract
OBJECTIVES: Bronchoscopy in the mechanically ventilated patient is an important skill for critical-care physicians. However, training opportunity is heterogenous and limited by infrequent caseload or inadequate instructor feedback for satisfactory competencies. A new artificial intelligence (AI) navigational system using augmented reality – the Ambu Broncho Simulator – can guide bronchoscopy training. Is training with the AI system comparable to bedside, expert tutor instruction in improving bronchoscopy performance? DESIGN: A nonblinded, parallel group randomized controlled trial was conducted. SETTING: The study was conducted in a simulated setting at an academic university hospital. SUBJECTS: Critical-care physicians were invited to take part in the study. INTERVENTIONS: Forty participants received 30 minutes of bronchoscopy training, either guided by AI only (artificial intelligence group [AIG]) or by expert tutor feedback (expert tutor group [ETG]). All participants performed a final full navigation bronchoscopy performance test and completed a cognitive load questionnaire, the NASA Task Load Index . MEASUREMENTS AND MAIN RESULTS: Mean intersegmental time (MIT = PT/DC), diagnostic completeness (DC), procedure time (PT), structured progress (SP), and number of segments revisited (SR) were measured. The primary outcome measure assessed was MIT, a measure of bronchoscopic performance efficiency. The secondary outcome measures were DC, PT, SP, and SR. Nineteen participants were randomized to the AIG and 21 participants to the ETG. MIT, PT, and SR were significantly better in the AIG compared to the ETG (median difference, p): MIT (–7.9 s, 0.027), PT (–77 s, 0.022), SR (–7 segments, 0.019); all showing moderate effect sizes (0.35, 0.36, and 0.37, respectively) as per Cohen’s classification. There was no significant difference between the groups for all other final test measures. CONCLUSIONS: Training using an AI system resulted in faster and more efficient bronchoscopy performance by critical-care physicians when compared to expert human tutor instruction. This could change the future of bronchoscopy training in critical care and warrants validation in patients through clinical studies.Keywords
This publication has 41 references indexed in Scilit:
- Artificial Intelligence Improves Novices’ Bronchoscopy PerformanceChest, 2023
- Bronchoscopy Simulation Training as a Tool in Medical School EducationThe Annals of Thoracic Surgery, 2018
- Perceiving haptic feedback in virtual reality simulatorsSurgical Endoscopy, 2013
- The Emerging Role of Simulation Education to Achieve Patient SafetyPediatric Clinics of North America, 2012
- Too little appreciation for great expenditure? Workload and resources in ICUsInternational Archives of Occupational and Environmental Health, 2011
- Mastery Learning of Temporary Hemodialysis Catheter Insertion by Nephrology Fellows Using Simulation Technology and Deliberate PracticeAmerican Journal of Kidney Diseases, 2009
- Bronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopyThe Annals of Thoracic Surgery, 2004
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988
- Knowledge of results and motor learning: A review and critical reappraisal.Psychological Bulletin, 1984
- Cardiorespiratory Effects of Flexible Fiberoptic Bronchoscopy in Critically III PatientsChest, 1978