Accuracy and self-validation of automated bone age determination
Authors:
Open Access
- 16 April 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-12
Abstract
The BoneXpert method for automated determination of bone age from hand X-rays was introduced in 2009 and is currently running in over 200 hospitals. The aim of this work is to present version 3 of the method and validate its accuracy and self-validation mechanism that automatically rejects an image if it is at risk of being analysed incorrectly. The training set included 14,036 images from the 2017 Radiological Society of North America (RSNA) Bone Age Challenge, 1642 images of normal Dutch and Californian children, and 8250 images from Tübingen from patients with Short Stature, Congenital Adrenal Hyperplasia and Precocious Puberty. The study resulted in a cross-validated root mean square (RMS) error in the Tübingen images of 0.62 y, compared to 0.72 y in the previous version. The RMS error on the RSNA test set of 200 images was 0.45 y relative to the average of six manual ratings. The self-validation mechanism rejected 0.4% of the RSNA images. 121 outliers among the self-validated images of the Tübingen study were rerated, resulting in 6 cases where BoneXpert deviated more than 1.5 years from the average of the three re-ratings, compared to 72 such cases for the original manual ratings. The accuracy of BoneXpert is clearly better than the accuracy of a single manual rating. The self-validation mechanism rejected very few images, typically with abnormal anatomy, and among the accepted images, there were 12 times fewer severe bone age errors than in manual ratings, suggesting that BoneXpert could be safer than manual rating.Keywords
This publication has 19 references indexed in Scilit:
- Validation of adult height prediction based on automated bone age determination in the Paris Longitudinal Study of healthy childrenPediatric Radiology, 2015
- Validation of automatic bone age determination in children with congenital adrenal hyperplasiaPediatric Radiology, 2013
- The Use of Bone Age in Clinical Practice – Part 2Hormone Research in Paediatrics, 2011
- The Use of Bone Age in Clinical Practice – Part 1Hormone Research in Paediatrics, 2011
- Validation of automatic bone age rating in children with precocious and early pubertyJournal of Pediatric Endocrinology and Metabolism, 2011
- Comparison of bone age readings by pediatric endocrinologists and pediatric radiologists using two bone age atlasesPediatric Radiology, 2010
- Validation and Reference Values of Automated Bone Age Determination for Four EthnicitiesAcademic Radiology, 2010
- Clinical application of automated Greulich-Pyle bone age determination in children with short staturePediatric Radiology, 2009
- Automatic determination of Greulich and Pyle bone age in healthy Dutch childrenPediatric Radiology, 2009
- Racial Differences in Growth Patterns of Children Assessed on the Basis of Bone AgeRadiology, 2009