PViTGAtt-IP: Severity Quantification of Lung Infections in Chest X-Rays and CT Scans via Parallel and Cross-Attended Encoders
- 31 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 11 (5) , 2736-2748
Abstract
The development of a robust and adaptive deep learning technique for the diagnosis of pneumonia and the assessment of its severity was a major challenge. Indeed, both chest X-rays (CXR) and CT scans have been widely studied for the diagnosis, detection and quantification of pneumonia. In this paper, a novel approach (PViTGAtt-IP) based on a parallel array of vision transformers is presented, in which the input image is divided into regions of interest. Each region is fed into an individual model and the collective output gives the severity score. Three parallel architectures were also derived and tested. The proposed models were subjected to rigorous tests on two different datasets: RALO CXRs and Per COVID-19 CT scans. The experimental results showed that the proposed models exhibited high performance in accurately predicting scores for both datasets. In particular, the parallel transformers with multi-gate attention proved to be the best performing model. Furthermore, a comparative analysis using state-of-the-art methods showed that our proposed approach consistently achieved competitive or even better performance in terms of the Mean Absolute Error (MAE) and the Pearson Correlation Coefficient (PC). This emphasizes the effectiveness and superiority of our models in the context of diagnosing and assessing the severity of pneumonia.Keywords
This publication has 57 references indexed in Scilit:
- Lung pneumonia severity scoring in chest X-ray images using transformersMedical & Biological Engineering & Computing, 2024
- Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature reviewMultimedia Tools and Applications, 2023
- Lung nodule detection in chest CT images based on vision transformer network with Bayesian optimizationBiomedical Signal Processing and Control, 2023
- 3D multi-scale vision transformer for lung nodule detection in chest CT imagesSignal, Image and Video Processing, 2023
- A review on deep learning in medical image analysisInternational Journal of Multimedia Information Retrieval, 2021
- Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19Journal of Medical Systems, 2021
- Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in ChinaJAMA, 2020
- A Review of Coronavirus Disease-2019 (COVID-19)Indian Journal of Pediatrics, 2020
- Empirical Risk Minimization2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015