M$^3$Lung-Sys: A Deep Learning System for Multi-Class Lung Pneumonia Screening From CT Imaging
- 13 October 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 24 (12) , 3539-3550
Abstract
To counter the outbreak of COVID-19, the accurate diagnosis of suspected cases plays a crucial role in timely quarantine, medical treatment, and preventing the spread of the pandemic. Considering the limited training cases and resources (e.g, time and budget), we propose a Multi-task Multi-slice Deep Learning System ( $M^3$ Lung-Sys) for multi-class lung pneumonia screening from CT imaging, which only consists of two 2D CNN networks, i.e., slice- and patient-level classification networks. The former aims to seek the feature representations from abundant CT slices instead of limited CT volumes, and for the overall pneumonia screening, the latter one could recover the temporal information by feature refinement and aggregation between different slices. In addition to distinguish COVID-19 from Healthy, H1N1, and CAP cases, our $M^3$ Lung-Sys also be able to locate the areas of relevant lesions, without any pixel-level annotation. To further demonstrate the effectiveness of our model, we conduct extensive experiments on a chest CT imaging dataset with a total of 734 patients (251 healthy people, 245 COVID-19 patients, 105 H1N1 patients, and 133 CAP patients). The quantitative results with plenty of metrics indicate the superiority of our proposed model on both slice- and patient-level classification tasks. More importantly, the generated lesion location maps make our system interpretable and more valuable to clinicians.
Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62076067)
- Science and Technology Commission of Shanghai Municipality (20441900600, 19ZR1471800)
- Shanghai Municipal Science and Technology (2017SHZDZX01)
This publication has 45 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Ensembles of Deep Learning Architectures for the Early Diagnosis of the Alzheimer’s DiseaseInternational Journal of Neural Systems, 2016
- Deep Residual Learning for Image Recognition2016
- Learning Deep Features for Discriminative Localization2016
- AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology ImagesIEEE Transactions on Medical Imaging, 2016
- Early diagnosis of Alzheimer's disease with deep learning2014
- Computed Tomography Findings of Influenza A (H1N1) Pneumonia in AdultsJournal of Computer Assisted Tomography, 2012
- Pneumonia in novel swine-origin influenza A (H1N1) virus infection: High-resolution CT findingsEuropean Journal of Radiology, 2011
- A simple and efficient connected components labeling algorithm2003
- A Quantitative Theory of the Hounsfield Unit and Its Application to Dual Energy ScanningJournal of Computer Assisted Tomography, 1977