Semantic-Powered Explainable Model-Free Few-Shot Learning Scheme of Diagnosing COVID-19 on Chest X-Ray
- 8 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 26 (12) , 5870-5882
Abstract
Chest X-ray (CXR) is commonly performed as an initial investigation in COVID-19, whose fast and accurate diagnosis is critical. Recently, deep learning has a great potential in detecting people who are suspected to be infected with COVID-19. However, deep learning resulting with black-box models, which often breaks down when forced to make predictions about data for which limited supervised information is available and lack inter-pretability, still is a major barrier for clinical integration. In this work, we hereby propose a semantic-powered explainable model-free few-shot learning scheme to quickly and precisely diagnose COVID-19 with higher reliability and transparency. Specifically, we design a Report Image Explanation Cell (RIEC) to exploit clinically indicators derived from radiology reports as interpretable driver to introduce prior knowledge at training. Meanwhile, multi-task colla-borative diagnosis strategy (MCDS) is developed to construct ${\bm{N}}$ -way ${\bm{K}}$ -shot tasks, which adopts a cyclic and collaborative training approach for producing better generalization performance on new tasks. Extensive experiments demonstrate that the proposed scheme achieves competitive results (accuracy of 98.91%, precision of 98.95%, recall of 97.94% and F1-score of 98.57%) to diagnose COVID-19 and other pneumonia infected categories, even with only 200 paired CXR images and radiology reports for training. Furthermore, statistical results of comparative experiments show that our scheme provides an interpretable window into the COVID-19 diagnosis to improve the performance of the small sample size, the reliability and transparency of black-box deep learning mod-els. Our source codes will be released on https://github.com/AI-medical-diagnosis-team-of-JNU/SPEMFSL-Diagnosis-COVID-19.Keywords
Funding Information
- National Key R&D Program of China (2018YFA0701700, 2021YFE0203700)
- Postgraduate Research and Practice Innovation Program of Jiangsu Province (SJCX22_1106)
- National Natural Science Foundation of China (61602007, U21A20521, 61731008)
- Zhejiang Provincial Natural Science Foundation of China (LZ15F010001)
- Universidade de Macau (FHS-CRDA-029-002-2017, MYRG2018-00071-FHS)
- Science and Technology Development Fund, Macau SAR (0004/2019/AFJ, 0011/2019/AKP)
This publication has 34 references indexed in Scilit:
- Chest CT for Typical Coronavirus Disease 2019 (COVID-19) Pneumonia: Relationship to Negative RT-PCR TestingRadiology, 2020
- Self-supervised learning for medical image analysis using image context restorationMedical Image Analysis, 2019
- Composing Text and Image for Image Retrieval - an Empirical Odyssey2019
- Attributes as Operators: Factorizing Unseen Attribute-Object Compositions2018
- Recurrent neural networks with specialized word embeddings for health-domain named-entity recognitionJournal of Biomedical Informatics, 2017
- Few-shot Learning Using a Small-Sized Dataset of High-Resolution FUNDUS Images for Glaucoma Diagnosis2017
- Recurrent neural networks for classifying relations in clinical notesJournal of Biomedical Informatics, 2017
- Image Question Answering Using Convolutional Neural Network with Dynamic Parameter Prediction2016
- Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images2015
- Long Short-Term MemoryNeural Computation, 1997