Identifying relations of medications with adverse drug events using recurrent convolutional neural networks and gradient boosting
Authors:
- 28 August 2019
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 27 (1) , 65-72
Abstract
Objective: To develop a natural language processing system that identifies relations of medications with adverse drug events from clinical narratives. This project is part of the 2018 n2c2 challenge.Materials and Methods: We developed a novel clinical named entity recognition method based on an recurrent convolutional neural network and compared it to a recurrent neural network implemented using the long-short term memory architecture, explored methods to integrate medical knowledge as embedding layers in neural networks, and investigated 3 machine learning models, including support vector machines, random forests and gradient boosting for relation classification. The performance of our system was evaluated using annotated data and scripts provided by the 2018 n2c2 organizers.Results: Our system was among the top ranked. Our best model submitted during this challenge (based on recurrent neural networks and support vector machines) achieved lenient F1 scores of 0.9287 for concept extraction (ranked third), 0.9459 for relation classification (ranked fourth), and 0.8778 for the end-to-end relation extraction (ranked second). We developed a novel named entity recognition model based on a recurrent convolutional neural network and further investigated gradient boosting for relation classification. The new methods improved the lenient F1 scores of the 3 subtasks to 0.9292, 0.9633, and 0.8880, respectively, which are comparable to the best performance reported in this challenge.Conclusion: This study demonstrated the feasibility of using machine learning methods to extract the relations of medications with adverse drug events from clinical narratives.Keywords
Funding Information
- University of Florida Clinical
- Translational Science Institute
- NIH National Center for Advancing Translational Sciences (UL1TR001427, NIA R21AG062884)
- NIH
This publication has 31 references indexed in Scilit:
- Natural language processing: State of the art and prospects for significant progress, a workshop sponsored by the National Library of MedicineJournal of Biomedical Informatics, 2013
- Recognizing clinical entities in hospital discharge summaries using Structural Support Vector Machines with word representation featuresBMC Medical Informatics and Decision Making, 2013
- Natural language processing: an introductionJournal of the American Medical Informatics Association, 2011
- A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summariesJournal of the American Medical Informatics Association, 2011
- Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010Journal of the American Medical Informatics Association, 2011
- 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical textJournal of the American Medical Informatics Association, 2011
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applicationsJournal of the American Medical Informatics Association, 2010
- Long Short-Term MemoryNeural Computation, 1997
- A General Natural-language Text Processor for Clinical RadiologyJournal of the American Medical Informatics Association, 1994