Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays
Authors:
- 16 September 2022
- book chapter
- Published by Springer Nature
- Vol. 13435, 658-668
Abstract
Creating a large-scale dataset of abnormality annotation on medical images is a labor-intensive and costly task. Leveraging weak supervision from readily available data such as radiology reports can compensate lack of large-scale data for anomaly detection methods. However, most of the current methods only use image-level pathological observations, failing to utilize the relevant anatomy mentions in reports. Furthermore, Natural Language Processing (NLP)-mined weak labels are noisy due to label sparsity and linguistic ambiguity. We propose an Anatomy-Guided chest X-ray Network (AGXNet) to address these issues of weak annotation. Our framework consists of a cascade of two networks, one responsible for identifying anatomical abnormalities and the second responsible for pathological observations. The critical component in our framework is an anatomy-guided attention module that aids the downstream observation network in focusing on the relevant anatomical regions generated by the anatomy network. We use Positive Unlabeled (PU) learning to account for the fact that lack of mention does not necessarily mean a negative label. Our quantitative and qualitative results on the MIMIC-CXR dataset demonstrate the effectiveness of AGXNet in disease and anatomical abnormality localization. Experiments on the NIH Chest X-ray dataset show that the learned feature representations are transferable and can achieve the state-of-the-art performances in disease classification and competitive disease localization results. Our code is available at https://github.com/batmanlab/AGXNet.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Knowledge-Augmented Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022
- Improving Pneumonia Localization via Cross-Attention on Medical Images and Reports2021
- Teaching Medical Students How to Interpret Chest X-Rays: The Design and Development of an e-Learning ResourceAdvances in Medical Education and Practice, 2021
- Weakly Supervised One-Stage Vision and Language Disease Detection Using Large Scale Pneumonia and Pneumothorax Studies2020
- Computer-aided detection in chest radiography based on artificial intelligence: a surveyBioMedical Engineering OnLine, 2018
- NegBio: a high-performance tool for negation and uncertainty detection in radiology reports2018
- Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural NetworksRadiology, 2017
- Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in childrenJournal of Hospital Medicine, 2011
- Comparison of Computer-Aided Detection to Double Reading of Screening Mammograms: Review of 231,221 MammogramsAmerican Journal of Roentgenology, 2008
- Computer aided detection (CAD): an overviewCancer Imaging, 2005