Unraveling the Impact of Class Imbalance on Deep-Learning Models for Medical Image Classification
Open Access
- 18 April 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (8) , 3419
Abstract
The field of image analysis with artificial intelligence has grown exponentially thanks to the development of neural networks. One of its most promising areas is medical diagnosis through lung X-rays, which are crucial for diseases like pneumonia, which can be mistaken for other conditions. Despite medical expertise, precise diagnosis is challenging, and this is where well-trained algorithms can assist. However, working with medical images presents challenges, especially when datasets are limited and unbalanced. Strategies to balance these classes have been explored, but understanding their local impact and how they affect model evaluation is still lacking. This work aims to analyze how a class imbalance in a dataset can significantly influence the informativeness of metrics used to evaluate predictions. It demonstrates that class separation in a dataset impacts trained models and is a strategy deserving more attention in future research. To achieve these goals, classification models using artificial and deep neural networks implemented in the R environment are developed. These models are trained using a set of publicly available images related to lung pathologies. All results are validated using metrics obtained from the confusion matrix to verify the impact of data imbalance on the performance of medical diagnostic models. The results raise questions about the procedures used to group classes in many studies, aiming to achieve class balance in imbalanced data and open new avenues for future research to investigate the impact of class separation in datasets with clinical pathologies.Keywords
Funding Information
- Programa de Estímulo a la Excelencia para Profesorado Universitario Permanente (EPU-INV/2020/004)
This publication has 35 references indexed in Scilit:
- Systematic review of deep learning image analyses for the diagnosis and monitoring of skin diseasenpj Digital Medicine, 2023
- A Comparative Study on R Packages for Text MiningIEEE Access, 2023
- Intelligent classification of lung malignancies using deep learning techniquesInternational Journal of Intelligent Computing and Cybernetics, 2021
- Performance Metrics for Artificial Intelligence (AI) Algorithms Adopted in Prognostics and Health Management (PHM) of Mechanical SystemsJournal of Physics: Conference Series, 2021
- Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspectsJournal of Infection and Public Health, 2020
- An Efficient Content-Based Image Retrieval System for the Diagnosis of Lung DiseasesJournal of Digital Imaging, 2020
- EENA: Efficient Evolution of Neural Architecture2019
- Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep LearningCell, 2018
- Dynamic synapse: A new concept of neural representation and computationHippocampus, 1996
- A logical calculus of the ideas immanent in nervous activityBulletin of Mathematical Biology, 1943