Machine learning from clinical data sets of a contemporary decision for orthodontic tooth extraction
- 24 May 2021
- journal article
- research article
- Published by Wiley in Orthodontics & Craniofacial Research
- Vol. 24 (S2) , 193-200
Abstract
Objective: To examine the robustness of the published machine learning models in the prediction of extraction vs non‐extraction for a diverse US sample population seen by multiple providers.Setting and Sample Population: Diverse group of 838 patients (208 extraction, 630 non‐extraction) were consecutively enrolled.Materials and Methods: Two sets of input features (117 and 22) including clinical and cephalometric variables were identified based on previous studies. Random forest (RF) and multilayer perception (MLP) models were trained using these feature sets on the sample population and evaluated using measures including accuracy (ACC) and balanced accuracy (BA). A technique to identify incongruent data was used to explore underlying characteristics of the data set and split all samples into 2 groups (G1 and G2) for further model training.Results: Performance of the models (75%‐79% ACC and 72%‐76% BA) on the total sample population was lower than in previous research. Models were retrained and evaluated using G1 and G2 separately, and individual group MLP models yielded improved accuracy for G1 (96% ACC and 94% BA) and G2 (88% ACC and 85% BA). RF feature ranking showed differences between top features for G1 (maxillary crowding, mandibular crowding and L1‐NB) and G2 (age, mandibular crowding and lower lip to E‐plane).Conclusions: An incongruent data pattern exists in a consecutively enrolled patient population. Future work with incongruent data segregation and advanced artificial intelligence algorithms is needed to improve the generalization ability to make it ready to support clinical decision‐making.Keywords
Funding Information
- Foundation for Innovative Research Groups of the National Natural Science Foundation of China (1938533)
- National Institute of Dental and Craniofacial Research (DE022816)
This publication has 10 references indexed in Scilit:
- Deep Multi-Scale Mesh Feature Learning for Automated Labeling of Raw Dental Surfaces From 3D Intraoral ScannersIEEE Transactions on Medical Imaging, 2020
- Machine Learning in Orthodontics: Introducing a 3d Auto-segmentation and Auto-landmark Finder of Cbct Images To Assess Maxillary Constriction in Unilateral Impacted Canine patientsThe Angle Orthodontist, 2020
- Orthodontic Treatment Planning based on Artificial Neural NetworksScientific Reports, 2019
- Which factors influence orthodontists in their decision to extract? A questionnaire surveyJournal of Clinical and Experimental Dentistry, 2019
- Extraction of premolars for orthodontic reasons on the decline? A cross-sectional survey of BOS membersJournal of Orthodontics, 2018
- Extraction frequencies at a university orthodontic clinic in the 21st century: Demographic and diagnostic factors affecting the likelihood of extractionAmerican Journal of Orthodontics and Dentofacial Orthopedics, 2017
- New approach for the diagnosis of extractions with neural network machine learningAmerican Journal of Orthodontics and Dentofacial Orthopedics, 2016
- Artificial Neural Network Modeling for Deciding if Extractions Are Necessary Prior to Orthodontic TreatmentThe Angle Orthodontist, 2010
- The functional impact of extraction and nonextraction treatments: A long-term comparison in patients with “borderline,” equally susceptible class II malocclusionsAmerican Journal of Orthodontics and Dentofacial Orthopedics, 1994
- The prevalence of orthodontic extractionsAmerican Journal of Orthodontics and Dentofacial Orthopedics, 1989