Novel Scoring Scale for Quality Assessment of Lung Ultrasound in the Emergency Department
Open Access
- 1 March 2024
- journal article
- research article
- Vol. 25 (2) , 264-267
Abstract
Introduction: The use of a reliable scoring system for quality assessment (QA) is imperative to limit inconsistencies in measuring ultrasound acquisition skills. The current grading scale used for QA endorsed by the American College of Emergency Physicians (ACEP) is non-specific, applies irrespective of the type of study performed, and has not been rigorously validated. Our goal in this study was to determine whether a succinct, organ-specific grading scale designed for lung-specific QA would be more precise with better interobserver agreement. Methods: This was a prospective validation study of an objective QA scale for lung ultrasound (LUS) in the emergency department. We identified the first 100 LUS performed in normal clinical practice in the year 2020. Four reviewers at an urban academic center who were either emergency ultrasound fellowship-trained or current fellows with at least six months of QA experience scored each study, resulting in a total of 400. The primary outcome was the level of agreement between the reviewers. Our secondary outcome was the variability of the scores given to the studies. For the agreement between reviewers, we computed the intraclass correlation coefficient (ICC) based on a two-way random-effect model with a single rater for each grading scale. We generated 10,000 bootstrapped ICCs to construct 95% confidence intervals (CI) for both grading systems. A two-sided one-sample t -test was used to determine whether there were differences in the bootstrapped ICCs between the two grading systems. Results: The ICC between reviewers was 0.552 (95% CI 0.40-0.68) for the ACEP grading scale and 0.703 (95% CI 0.59-0.79) for the novel grading scale (P < 0.001), indicating significantly more interobserver agreement using the novel scale compared to the ACEP scale. The variance of scores was similar (0.93 and 0.92 for the novel and ACEP scales, respectively). Conclusion: We found an increased interobserver agreement between reviewers when using the novel, organ-specific scale when compared with the ACEP grading scale. Increased consistency in feedback based on objective criteria directed to the specific, targeted organ provides an opportunity to enhance learner education and satisfaction with their ultrasound education.Keywords
This publication has 15 references indexed in Scilit:
- Simplified Lung Ultrasound Examination and Telehealth Feasibility in Early SARS-CoV-2 InfectionJournal of the American Society of Echocardiography, 2022
- Outcomes of Simplified Lung Ultrasound Exam in COVID‐19: Implications for Self‐ImagingJournal of Ultrasound in Medicine, 2021
- “Asymptomatic” Flash Pulmonary Edema by Point-of-Care UltrasoundJACC: Case Reports, 2020
- Reflections: A Perspective on Homeless Patients in the Emergency DepartmentAnnals of Emergency Medicine, 2019
- Thoracic ultrasonography: a narrative reviewIntensive Care Medicine, 2019
- Prognostic Implications of a Point‐of‐Care Ultrasound Examination on Hospital Ward AdmissionJournal of Ultrasound in Medicine, 2019
- Lung Ultrasound Findings Detected During Inpatient Echocardiography Are Common and Associated With Short‐ and Long‐term MortalityJournal of Ultrasound in Medicine, 2017
- Ultrasound Guidelines: Emergency, Point-of-Care and Clinical Ultrasound Guidelines in MedicineAnnals of Emergency Medicine, 2017
- Diagnostic performance of a pocket-sized ultrasound device for quick-look cardiac imagingThe American Journal of Emergency Medicine, 2012
- A score-based method to improve the quality of emergency gynaecological ultrasound examinationEuropean Journal of Obstetrics & Gynecology and Reproductive Biology, 2009