Artificial Intelligence–Assisted Bone Age Assessment to Improve the Accuracy and Consistency of Physicians With Different Levels of Experience
Authors:
Open Access
- 24 February 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Pediatrics
- Vol. 10, 818061
Abstract
Background: The accuracy and consistency of bone age assessments (BAA) using standard methods can vary with physicians' level of experience.Methods: To assess the impact of information from an artificial intelligence (AI) deep learning convolutional neural network (CNN) model on BAA, specialists with different levels of experience (junior, mid-level, and senior) assessed radiographs from 316 children aged 4–18 years that had been randomly divided into two equal sets-group A and group B. Bone age (BA) was assessed independently by each specialist without additional information (group A) and with information from the model (group B). With the mean assessment of four experts as the reference standard, mean absolute error (MAE), and intraclass correlation coefficient (ICC) were calculated to evaluate accuracy and consistency. Individual assessments of 13 bones (radius, ulna, and short bones) were also compared between group A and group B with the rank-sum test.Results: The accuracies of senior, mid-level, and junior physicians were significantly better (all P < 0.001) with AI assistance (MAEs 0.325, 0.344, and 0.370, respectively) than without AI assistance (MAEs 0.403, 0.469, and 0.755, respectively). Moreover, for senior, mid-level, and junior physicians, consistency was significantly higher (all P < 0.001) with AI assistance (ICCs 0.996, 0.996, and 0.992, respectively) than without AI assistance (ICCs 0.987, 0.989, and 0.941, respectively). For all levels of experience, accuracy with AI assistance was significantly better than accuracy without AI assistance for assessments of the first and fifth proximal phalanges.Conclusions: Information from an AI model improves both the accuracy and the consistency of bone age assessments for physicians of all levels of experience. The first and fifth proximal phalanges are difficult to assess, and they should be paid more attention.Keywords
Funding Information
- Beijing Municipal Health Commission
This publication has 27 references indexed in Scilit:
- Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand RadiographsRadiology, 2018
- Computerized Bone Age Estimation Using Deep Learning Based Program: Evaluation of the Accuracy and EfficiencyAmerican Journal of Roentgenology, 2017
- Deep learning for automated skeletal bone age assessment in X-ray imagesMedical Image Analysis, 2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Automated Determination of Bone Age in a Modern Chinese PopulationISRN Radiology, 2013
- Automation of Bone Age Reading and a New Prediction Model Improve Adult Height Prediction in Children with Short StatureHormone Research in Paediatrics, 2012
- Clinical application of automated Greulich-Pyle bone age determination in children with short staturePediatric Radiology, 2009
- [Reference values of differences between TW3-C RUS and TW3-C Carpal bone ages of children from five cities of China].2008
- RADIOGRAPHIC ATLAS OF SKELETAL DEVELOPMENT OF THE HAND AND WRISTThe American Journal of the Medical Sciences, 1959