FLANNEL (Focal Loss bAsed Neural Network EnsembLe) for COVID-19 detection
Open Access
- 30 October 2020
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 28 (3) , 444-452
Abstract
Objective: The study sought to test the possibility of differentiating chest x-ray images of coronavirus disease 2019 (COVID-19) against other pneumonia and healthy patients using deep neural networks. Materials and Methods: We construct the radiography (x-ray) imaging data from 2 publicly available sources, which include 5508 chest x-ray images across 2874 patients with 4 classes: normal, bacterial pneumonia, non–COVID-19 viral pneumonia, and COVID-19. To identify COVID-19, we propose a FLANNEL (Focal Loss bAsed Neural Network EnsembLe) model, a flexible module to ensemble several convolutional neural network models and fuse with a focal loss for accurate COVID-19 detection on class imbalance data. Results: FLANNEL consistently outperforms baseline models on COVID-19 identification task in all metrics. Compared with the best baseline, FLANNEL shows a higher macro-F1 score, with 6% relative increase on the COVID-19 identification task, in which it achieves precision of 0.7833 ± 0.07, recall of 0.8609 ± 0.03, and F1 score of 0.8168 ± 0.03. Discussion: Ensemble learning that combines multiple independent basis classifiers can increase the robustness and accuracy. We propose a neural weighing module to learn the importance weight for each base model and combine them via weighted ensemble to get the final classification results. In order to handle the class imbalance challenge, we adapt focal loss to our multiple classification task as the loss function. Conclusion: FLANNEL effectively combines state-of-the-art convolutional neural network classification models and tackles class imbalance with focal loss to achieve better performance on COVID-19 detection from x-rays.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CTRadiology, 2020
- Deep Learning for Classification and Localization of COVID-19 Markers in Point-of-Care Lung UltrasoundIEEE Transactions on Medical Imaging, 2020
- Diagnosis of Coronavirus Disease 2019 (COVID-19) With Structured Latent Multi-View Representation LearningIEEE Transactions on Medical Imaging, 2020
- Towards Contactless Patient PositioningIEEE Transactions on Medical Imaging, 2020
- Frequency and Distribution of Chest Radiographic Findings in Patients Positive for COVID-19Radiology, 2020
- Artificial intelligence–enabled rapid diagnosis of patients with COVID-19Nature Medicine, 2020
- Deep Learning COVID-19 Features on CXR Using Limited Training Data SetsIEEE Transactions on Medical Imaging, 2020
- Exploiting unlabeled data to enhance ensemble diversityData Mining and Knowledge Discovery, 2011
- On Combining Artificial Neural NetsConnection Science, 1996
- Neural network ensemblesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1990