Learning to Recognize Thoracic Disease in Chest X-Rays With Knowledge-Guided Deep Zoom Neural Networks
Open Access
- 31 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 159790-159805
Abstract
Automatic and accurate thorax disease diagnosis in Chest X-ray (CXR) image plays an essential role in clinical assist analysis. However, due to its imaging noise regions and the similarity of visual features between diseases and their surroundings, the precise analysis of thoracic disease becomes a challenging problem. In this study, we propose a novel knowledge-guided deep zoom neural network (KGZNet) which is a data-driven model. Our approach leverage prior medical knowledge to guide its training process, due to thoracic diseases typically limit within the lung regions. Also, we utilized weakly-supervised learning (WSL) to search for finer regions without using annotated samples. Learning on each scale consists of a classification sub-network. The KGZNet starts from global images, and iteratively generates discriminative part from coarse to fine; while a finer scale sub-network takes as input an amplified attended discriminative region from previous scales in a recurrent way. Specifically, we first train a robust modified U-Net model of lung segmentation and capture the lung area from the original CXR image through the Lung Region Generator. Then, guided by the attention heatmap, we obtain a finer discriminative lesion region from the lung region images by the Lesion Region Generator. Lastly, the most discriminative features knowledge is fused, and the complementary features information is learned for final disease prediction. Extensive experiments demonstrate that our method can effectively leverage discriminative region information, and significantly outperforms the other state-of-the-art methods in the thoracic disease recognition task. Furthermore, the proposed KGZNet can gradually learn the discriminative region from coarse to fine in a mutually reinforced way. The code is will available at: https://github.com/ISSE-AILab/KGZNet.Keywords
Funding Information
- Fundamental Research Funds for the Central Universities (2019CDYGYB014)
- National Key Research and Development Project of China (2018YFB2101200)
- Chongqing Major Theme Projects (cstc2018jszx-cyztzxX0017)
- National Natural Science Foundation of China (61772093)
This publication has 30 references indexed in Scilit:
- Densely Connected Convolutional Networks2017
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition2017
- Deep Residual Learning for Image Recognition2016
- Learning Deep Features for Discriminative Localization2016
- Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural NetworkIEEE Transactions on Medical Imaging, 2016
- Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer LearningIEEE Transactions on Medical Imaging, 2016
- A CNN Regression Approach for Real-Time 2D/3D RegistrationIEEE Transactions on Medical Imaging, 2016
- Going deeper with convolutions2015
- Long Short-Term MemoryNeural Computation, 1997