Deep Learning for Reliable Classification of COVID-19, MERS, and SARS from Chest X-ray Images
- 11 January 2022
- journal article
- research article
- Published by Springer Nature in Cognitive Computation
- Vol. 14 (5) , 1752-1772
Abstract
Novel coronavirus disease (COVID-19) is an extremely contagious and quickly spreading coronavirus infestation. Severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS), which outbreak in 2002 and 2011, and the current COVID-19 pandemic are all from the same family of coronavirus. This work aims to classify COVID-19, SARS, and MERS chest X-ray (CXR) images using deep convolutional neural networks (CNNs). To the best of our knowledge, this classification scheme has never been investigated in the literature. A unique database was created, so-called QU-COVID-family, consisting of 423 COVID-19, 144 MERS, and 134 SARS CXR images. Besides, a robust COVID-19 recognition system was proposed to identify lung regions using a CNN segmentation model (U-Net), and then classify the segmented lung images as COVID-19, MERS, or SARS using a pre-trained CNN classifier. Furthermore, the Score-CAM visualization method was utilized to visualize classification output and understand the reasoning behind the decision of deep CNNs. Several deep learning classifiers were trained and tested; four outperforming algorithms were reported: SqueezeNet, ResNet18, InceptionV3, and DenseNet201. Original and preprocessed images were used individually and all together as the input(s) to the networks. Two recognition schemes were considered: plain CXR classification and segmented CXR classification. For plain CXRs, it was observed that InceptionV3 outperforms other networks with a 3-channel scheme and achieves sensitivities of 99.5%, 93.1%, and 97% for classifying COVID-19, MERS, and SARS images, respectively. In contrast, for segmented CXRs, InceptionV3 outperformed using the original CXR dataset and achieved sensitivities of 96.94%, 79.68%, and 90.26% for classifying COVID-19, MERS, and SARS images, respectively. The classification performance degrades with segmented CXRs compared to plain CXRs. However, the results are more reliable as the network learns from the main region of interest, avoiding irrelevant non-lung areas (heart, bones, or text), which was confirmed by the Score-CAM visualization. All networks showed high COVID-19 detection sensitivity (> 96%) with the segmented lung images. This indicates the unique radiographic signature of COVID-19 cases in the eyes of AI, which is often a challenging task for medical doctors.Keywords
All Related Versions
Funding Information
- Qatar University (QUERG-CENG-2020-1)
This publication has 38 references indexed in Scilit:
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Densely Connected Convolutional Networks2017
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Clinical Implications of 5 Cases of Middle East Respiratory Syndrome Coronavirus Infection in a South Korean OutbreakJapanese Journal of Infectious Diseases, 2016
- Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid RegistrationIEEE Transactions on Medical Imaging, 2013
- Automatic Tuberculosis Screening Using Chest RadiographsIEEE Transactions on Medical Imaging, 2013
- Severe Acute Respiratory Syndrome: Radiographic Review of 40 Probable Cases in Toronto, CanadaRadiology, 2003
- An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancementIEEE Transactions on Medical Imaging, 1988
- Adaptive histogram equalization and its variationsComputer Vision, Graphics, and Image Processing, 1987