Handling Imbalance and Limited Data in Thyroid Ultrasound and Diabetic Retinopathy Datasets Using Discrete Levy Flights Grey Wolf Optimizer Based Random Forest for Robust Medical Data Classification
Open Access
- 16 February 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
Abstract
In the field of disease diagnosis, medical image classification faces an inherent challenge due to various factors involving data imbalance, image quality variability, annotation variability, and limited data availability and data representativeness. Such challenges affect the algorithm's classification ability on the medical images in an adverse way, which leads to biased model outcomes and inaccurate interpretations. In this paper, a novel Discrete Levy Flight Grey Wolf Optimizer (DLFGWO) is combined with the Random Forest (RF) classifier to address the above limitations on the biomedical datasets and to achieve better classification rate. The DLFGWO-RF resolves the image quality variability in ultrasound images and limits the inaccuracies on classification using RF by handling the incomplete and noisy data. The sheer focus on the majority class may lead to unequal distribution of classes and thus leads to data imbalance. The DLFGWO balances such distribution by leveraging grey wolves and its exploration and exploitation capabilities are improved using Discrete Levy Flight (DLF). It further optimizes the classifier's performance to achieve balanced classification rate. DLFGWO-RF is designed to perform classification even on limited datasets, thereby the requirement of numerous expert annotations can thus be reduced. In diabetic retinopathy grading, the DLFGWO-RF reduces disagreements in annotation variability using subjective interpretations. However, the representativeness of the diabetic retinopathy dataset fails to capture the entire population diversity, which limits the generalization ability of the proposed DLFGWO-RF. Thus, fine-tuning of RF can robustly adapt to the subgroups in the dataset, enhancing its overall performance. The experiments are conducted on two widely used medical image datasets to test the efficacy of the model. The experimental results show that the DLFGWO-RF classifier achieves improved classification accuracy between 90-95%, which outperforms the existing techniques for various imbalanced datasets.Keywords
This publication has 19 references indexed in Scilit:
- A Novel Extra Tree Ensemble Optimized DL Framework (ETEODL) for Early Detection of DiabetesFrontiers in Public Health, 2022
- Transfer learning techniques for medical image analysis: A reviewBiocybernetics and Biomedical Engineering, 2022
- What Disease Does This Patient Have? A Large-Scale Open Domain Question Answering Dataset from Medical ExamsApplied Sciences, 2021
- Automatic Vertebral Body Segmentation Based on Deep Learning of Dixon Images for Bone Marrow Fat Fraction QuantificationFrontiers in Endocrinology, 2020
- Whale Optimization for Wavelet-Based Unsupervised Medical Image Segmentation: Application to CT and MR ImagesInternational Journal of Computational Intelligence Systems, 2020
- I-GWO and Ex-GWO: improved algorithms of the Grey Wolf Optimizer to solve global optimization problemsEngineering with Computers, 2019
- Dual feature selection and rebalancing strategy using metaheuristic optimization algorithms in X-ray image datasetsMultimedia Tools and Applications, 2019
- Learning from Imbalanced Data Sets2018
- Deep Learning for Medical Image Processing: Overview, Challenges and the Future2017
- FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance LearningIEEE Transactions on Fuzzy Systems, 2010