Iterative Tuning of Tree-Ensemble-Based Models' parameters Using Bayesian Optimization for Breast Cancer Prediction
Open Access
- 11 January 2024
- journal article
- research article
- Published by SPIIRAS in Informatics and Automation
- Vol. 23 (1) , 129-168
Abstract
The study presents a method for iterative parameter tuning of tree ensemble-based models using Bayesian hyperparameter tuning for states prediction, using breast cancer as an example. The proposed method utilizes three different datasets, including the Wisconsin Diagnostic Breast Cancer (WDBC) dataset, the Surveillance, Epidemiology, and End Results (SEER) breast cancer dataset, and the Breast Cancer Coimbra dataset (BCCD), and implements tree ensemble-based models, specifically AdaBoost, Gentle-Boost, LogitBoost, Bag, and RUSBoost, for breast cancer prediction. Bayesian optimization was used to tune the hyperparameters of the models iteratively, and the performance of the models was evaluated using several metrics, including accuracy, precision, recall, and f1-score. Our results show that the proposed method significantly improves the performance of tree ensemble-based models, resulting in higher accuracy, precision, recall, and f1-score. Compared to other state-of-the-art models, the proposed method is more efficient. It achieved perfect scores of 100% for Accuracy, Precision, Recall, and F1-Score on the WDBC dataset. On the SEER BC dataset, the method achieved an accuracy of 95.9%, a precision of 97.6%, a recall of 94.2%, and an F1-Score of 95.9%. For the BCCD dataset, the method achieved an accuracy of 94.7%, a precision of 90%, a recall of 100%, and an F1-Score of 94.7%. The outcomes of this study have important implications for medical professionals, as early detection of breast cancer can significantly increase the chances of survival. Overall, this study provides a valuable contribution to the field of breast cancer prediction using machine learning.Keywords
This publication has 37 references indexed in Scilit:
- Breast Cancer Detection using SVM Classifier with Grid Search TechniqueInternational Journal of Computer Applications, 2019
- Establishment and Verification of a Bagged-Trees-Based Model for Prediction of Sentinel Lymph Node Metastasis for Early Breast Cancer PatientsFrontiers in Oncology, 2019
- A dynamic gradient boosting machine using genetic optimizer for practical breast cancer prognosisExpert Systems with Applications, 2019
- Can-CSC-GBE: Developing Cost-sensitive Classifier with Gentleboost Ensemble for breast cancer classification using protein amino acids and imbalanced dataComputers in Biology and Medicine, 2016
- A genetic algorithm for optimizing subnetwork markers for the study of breast cancer metastasis2011
- RUSBoost: A Hybrid Approach to Alleviating Class ImbalanceIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2009
- Evaluation of BRCA1 and BRCA2 mutations and risk-prediction models in a typical Asian country (Malaysia) with a relatively low incidence of breast cancerBreast Cancer Research, 2008
- Analyzing baggingThe Annals of Statistics, 2002
- Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors)The Annals of Statistics, 2000
- Bagging predictorsMachine Learning, 1996