Multi-Modal Machine Learning Approach for COVID-19 Detection Using Biomarkers and X-Ray Imaging
Author:
Open Access
- 13 December 2024
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 14 (24) , 2800
Abstract
Background: Accurate and rapid detection of COVID-19 remains critical for clinical management, especially in resource-limited settings. Current diagnostic methods face challenges in terms of speed and reliability, creating a need for complementary AI-based models that integrate diverse data sources. Objectives: This study aimed to develop and evaluate a multi-modal machine learning model that combines clinical biomarkers and chest X-ray images to enhance diagnostic accuracy and provide interpretable insights. Methods: We used a dataset of 250 patients (180 COVID-19 positive and 70 negative cases) collected from clinical settings. Biomarkers such as CRP, ferritin, NLR, and albumin were included alongside chest X-ray images. Random Forest and Gradient Boosting models were used for biomarkers, and ResNet and VGG CNN architectures were applied to imaging data. A late-fusion strategy integrated predictions from these modalities. Stratified k-fold cross-validation ensured robust evaluation while preventing data leakage. Model performance was assessed using AUC-ROC, F1-score, Specificity, Negative Predictive Value (NPV), and Matthews Correlation Coefficient (MCC), with confidence intervals calculated via bootstrap resampling. Results: The Gradient Boosting + VGG fusion model achieved the highest performance, with an AUC-ROC of 0.94, F1-score of 0.93, Specificity of 93%, NPV of 96%, and MCC of 0.91. SHAP and LIME interpretability analyses identified CRP, ferritin, and specific lung regions as key contributors to predictions. Discussion: The proposed multi-modal approach significantly enhances diagnostic accuracy compared to single-modality models. Its interpretability aligns with clinical understanding, supporting its potential for real-world application.Keywords
This publication has 52 references indexed in Scilit:
- RETRACTED: Reviewing methods of deep learning for diagnosing COVID-19, its variants and synergistic medicine combinationsComputers in Biology and Medicine, 2023
- Machine learning for medical imaging‐based COVID‐19 detection and diagnosisInternational Journal of Intelligent Systems, 2021
- Deep-chest: Multi-classification deep learning model for diagnosing COVID-19, pneumonia, and lung cancer chest diseasesComputers in Biology and Medicine, 2021
- A machine learning-based framework for diagnosis of COVID-19 from chest X-ray imagesInterdisciplinary Sciences: Computational Life Sciences, 2021
- CoroDet: A deep learning based classification for COVID-19 detection using chest X-ray imagesChaos, Solitons & Fractals, 2021
- Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning techniqueChaos, Solitons & Fractals, 2020
- CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray imagesComputer Methods and Programs in Biomedicine, 2020
- A deep learning approach to detect Covid-19 coronavirus with X-Ray imagesBiocybernetics and Biomedical Engineering, 2020
- The investigation of multiresolution approaches for chest X-ray image based COVID-19 detectionHealth Information Science and Systems, 2020
- Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networksPhysical and Engineering Sciences in Medicine, 2020