Automatic Generation of Pulmonary Radiology Reports with Semantic Tags
Authors:
- 1 October 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 162-167
Abstract
The chest X-ray is widely used in clinical practice for diagnosis and treatment. Among all chest diseases, pulmonary disease accounts for the majority, and the description of the lungs in the radiology report is the most complicated. According to this situation, this paper proposes a pulmonary radiology report generation model (SRN+BC-LSTM) based on semantic tags of radiograph. Firstly, for the problem that the image features extracted by CNN do not contain obvious semantic information, this paper selects the high frequency words related to abnormalities in the pulmonary radiology report as semantic tags, and trains the multi-label classifier. Secondly, a binary classifier is combined to improve the BLEU of generated normal reports since the Chinese radiology reports have roughly the same description for the normal samples. The experiment results indicated that our model is 13% higher than the baseline model in BLUE4.Keywords
This publication has 14 references indexed in Scilit:
- Boosting Image Captioning with Attributes2017
- A Hierarchical Approach for Generating Descriptive Image Paragraphs2017
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- Learning Spatial Regularization with Image-Level Supervisions for Multi-label Image Classification2017
- Deep Residual Learning for Image Recognition2016
- What Value Do Explicit High Level Concepts Have in Vision to Language Problems?2016
- Show and tell: A neural image caption generator2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Cell Proliferation Without Neurogenesis in Adult Primate NeocortexScience, 2001
- Long Short-Term MemoryNeural Computation, 1997