A self-attention based deep learning method for lesion attribute detection from CT reports
Authors:
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
In radiology, radiologists not only detect lesions from the medical image, but also describe them with various attributes such as their type, location, size, shape, and intensity. While these lesion attributes are rich and useful in many downstream clinical applications, how to extract them from the radiology reports is less studied. This paper outlines a novel deep learning method to automatically extract attributes of lesions of interest from the clinical text. Different from classical CNN models, we integrated the multi-head self-attention mechanism to handle the long-distance information in the sentence, and to jointly correlate different portions of sentence representation subspaces in parallel. Evaluation on an in-house corpus demonstrates that our method can achieve high performance with 0.848 in precision, 0.788 in recall, and 0.815 in F-score. The new method and constructed corpus will enable us to build automatic systems with a higher-level understanding of the radiological world.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) AnalysisIEEE Journal of Biomedical and Health Informatics, 2017
- Classifying tumor event attributes in radiology reportsJournal of the Association for Information Science and Technology, 2017
- Deep learning for extracting protein-protein interactions from biomedical literature2017
- Drug drug interaction extraction from biomedical literature using syntax convolutional neural networkBioinformatics, 2016
- Relation extraction from clinical texts using domain invariant convolutional neural network2016
- How to Train good Word Embeddings for Biomedical NLP2016
- A Shortest Dependency Path Based Convolutional Neural Network for Protein-Protein Relation ExtractionBioMed Research International, 2016
- The Effect of Faster Reporting Speed for Imaging Studies on the Number of Misses and Interpretation Errors: A Pilot StudyJournal of the American College of Radiology, 2015
- RadLex: A New Method for Indexing Online Educational MaterialsRadioGraphics, 2006
- Bidirectional inference with the easiest-first strategy for tagging sequence data2005