Natural language processing and machine learning algorithm to identify brain MRI reports with acute ischemic stroke
Open Access
- 28 February 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 14 (2) , e0212778
Abstract
This project assessed performance of natural language processing (NLP) and machine learning (ML) algorithms for classification of brain MRI radiology reports into acute ischemic stroke (AIS) and non-AIS phenotypes. All brain MRI reports from a single academic institution over a two year period were randomly divided into 2 groups for ML: training (70%) and testing (30%). Using “quanteda” NLP package, all text data were parsed into tokens to create the data frequency matrix. Ten-fold cross-validation was applied for bias correction of the training set. Labeling for AIS was performed manually, identifying clinical notes. We applied binary logistic regression, naïve Bayesian classification, single decision tree, and support vector machine for the binary classifiers, and we assessed performance of the algorithms by F1-measure. We also assessed how n-grams or term frequency-inverse document frequency weighting affected the performance of the algorithms. Of all 3,204 brain MRI documents, 432 (14.3%) were labeled as AIS. AIS documents were longer in character length than those of non-AIS (median [interquartile range]; 551 [377–681] vs. 309 [164–396]). Of all ML algorithms, single decision tree had the highest F1-measure (93.2) and accuracy (98.0%). Adding bigrams to the ML model improved F1-mesaure of naïve Bayesian classification, but not in others, and term frequency-inverse document frequency weighting to data frequency matrix did not show any additional performance improvements. Supervised ML based NLP algorithms are useful for automatic classification of brain MRI reports for identification of AIS patients. Single decision tree was the best classifier to identify brain MRI reports with AIS.Keywords
Funding Information
- National Center for Advancing Translational Sciences (UL1 TR001450)
- SmartState Program in South Carolina
This publication has 44 references indexed in Scilit:
- Use of a support vector machine for categorizing free-text notes: assessment of accuracy across two institutionsJournal of the American Medical Informatics Association, 2013
- An Updated Definition of Stroke for the 21st CenturyStroke, 2013
- Practical Examples of Natural Language Processing in RadiologyJournal of the American College of Radiology, 2011
- Recombinant Tissue-Type Plasminogen Activator Use for Ischemic Stroke in the United StatesStroke, 2011
- Index-based Online Text Classification for SMS Spam FilteringJournal of Computers, 2010
- National US Estimates of Recombinant Tissue Plasminogen Activator UseStroke, 2008
- The use of bigrams to enhance text categorizationInformation Processing & Management, 2002
- Diffusion-weighted MR Imaging of the BrainRadiology, 2000
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988
- An algorithm for suffix strippingProgram: electronic library and information systems, 1980