Machine learning algorithms are comparable to conventional regression models in predicting distant metastasis of follicular thyroid carcinoma
- 16 February 2022
- journal article
- research article
- Published by Wiley in Clinical Endocrinology
- Vol. 98 (1) , 98-109
Abstract
Objective: Distant metastasis often indicates a poor prognosis, so early screening and diagnosis play a significant role. Our study aims to construct and verify a predictive model based on machine learning (ML) algorithms that can estimate the risk of distant metastasis of newly diagnosed follicular thyroid carcinoma (FTC).Design: This was a retrospective study based on the Surveillance, Epidemiology, and End Results (SEER) database from 2004 to 2015.Patients: A total of 5809 FTC patients were included in the data analysis. Among them, there were 214 (3.68%) cases with distant metastasis.Method: Univariate and multivariate logistic regression (LR) analyses were used to determine independent risk factors. Seven commonly used ML algorithms were applied for predictive model construction. We used the area under the receiver‐operating characteristic (AUROC) curve to select the best ML algorithm. The optimal model was trained through 10‐fold cross‐validation and visualized by SHapley Additive exPlanations (SHAP). Finally, we compared it with the traditional LR method.Results: In terms of predicting distant metastasis, the AUROCs of the seven ML algorithms were 0.746–0.836 in the test set. Among them, the Extreme Gradient Boosting (XGBoost) had the best prediction performance, with an AUROC of 0.836 (95% confidence interval [CI]: 0.775–0.897). After 10‐fold cross‐validation, its predictive power could reach the best [AUROC: 0.855 (95% CI: 0.803–0.906)], which was slightly higher than the classic binary LR model [AUROC: 0.845 (95% CI: 0.818–0.873)].Conclusions: The XGBoost approach was comparable to the conventional LR method for predicting the risk of distant metastasis for FTC.Keywords
This publication has 29 references indexed in Scilit:
- Early prognostic factors at the time of diagnosis of bone metastasis in patients with bone metastases of differentiated thyroid carcinomaEuropean Journal of Endocrinology, 2016
- Thyroid cancer mortality and incidence: A global overviewInternational Journal of Cancer, 2014
- Update on the molecular diagnosis and targeted therapy of thyroid cancerMedical Oncology, 2014
- Machine Learning Algorithms Outperform Conventional Regression Models in Predicting Development of Hepatocellular CarcinomaAmerican Journal of Gastroenterology, 2013
- Population-Based Study Evaluating and Predicting the Probability of Death Resulting From Thyroid Cancer and Other Causes Among Patients With Thyroid CancerJournal of Clinical Oncology, 2013
- Osteoporosis Risk Prediction for Bone Mineral Density Assessment of Postmenopausal Women Using Machine LearningYonsei Medical Journal, 2013
- Management of follicular thyroid carcinoma should be individualised based on degree of capsular and vascular invasionEuropean Journal of Surgical Oncology, 2011
- The Basis of Racial Differences in the Incidence of Thyroid CancerAnnals of Surgical Oncology, 2008
- Follicular Thyroid CarcinomaAnnals of Surgery, 2005
- Prediction error estimation: a comparison of resampling methodsBioinformatics, 2005