The Power Of Simplicity: Why Simple Linear Models Outperform Complex Machine Learning Techniques -- Case Of Breast Cancer Diagnosis
Preprint
Abstract
This research paper investigates the effectiveness of simple linear models versus complex machine learning techniques in breast cancer diagnosis, emphasizing the importance of interpretability and computational efficiency in the medical domain. We focus on Logistic Regression (LR), Decision Trees (DT), and Support Vector Machines (SVM) and optimize their performance using the UCI Machine Learning Repository dataset. Our findings demonstrate that the simpler linear model, LR, outperforms the more complex DT and SVM techniques, with a test score mean of 97.28%, a standard deviation of 1.62%, and a computation time of 35.56 ms. In comparison, DT achieved a test score mean of 93.73%, and SVM had a test score mean of 96.44%. The superior performance of LR can be attributed to its simplicity and interpretability, which provide a clear understanding of the relationship between input features and the outcome. This is particularly valuable in the medical domain, where interpretability is crucial for decision-making. Moreover, the computational efficiency of LR offers advantages in terms of scalability and real-world applicability. The results of this study highlight the power of simplicity in the context of breast cancer diagnosis and suggest that simpler linear models like LR can be more effective, interpretable, and computationally efficient than their complex counterparts, making them a more suitable choice for medical applications.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 CountriesCA: A Cancer Journal for Clinicians, 2021
- Comparing Logistic Regression Models with Alternative Machine Learning Methods to Predict the Risk of Drug Intoxication MortalityInternational Journal of Environmental Research and Public Health, 2020
- Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countriesCA: A Cancer Journal for Clinicians, 2018
- Breast cancer classification using deep belief networksExpert Systems with Applications, 2016
- Prevalence of Mammographically Dense Breasts in the United StatesJNCI: Journal of the National Cancer Institute, 2014
- Breast cancer screening in an era of personalized regimens: A conceptual model and National Cancer Institute initiative for risk‐based and preference‐based approaches at a population levelCancer, 2014
- Kernel Methods for Pattern Analysis2004