Using natural language processing for automated classification of disease and to identify misclassified ICD codes in cardiac disease
Open Access
- 9 February 2024
- journal article
- research article
- Published by Oxford University Press (OUP) in European Heart Journal - Digital Health
- Vol. 5 (3) , 229-234
Abstract
ICD codes are used for classification of hospitalizations. The codes are used for administrative, financial, and research purposes. It is known, however, that errors occur. Natural language processing (NLP) offers promising solutions for optimizing the process. To investigate methods for automatic classification of disease in unstructured medical records using NLP and to compare these to conventional ICD coding. Two datasets were used: the open-source Medical Information Mart for Intensive Care (MIMIC)-III dataset (n = 55.177) and a dataset from a hospital in Belgium (n = 12.706). Automated searches using NLP algorithms were performed for the diagnoses ‘atrial fibrillation (AF)’ and ‘heart failure (HF)’. Four methods were used: rule-based search, logistic regression, term frequency-inverse document frequency (TF-IDF), Extreme Gradient Boosting (XGBoost), and Bio-Bidirectional Encoder Representations from Transformers (BioBERT). All algorithms were developed on the MIMIC-III dataset. The best performing algorithm was then deployed on the Belgian dataset. After preprocessing a total of 1438 reports was retained in the Belgian dataset. XGBoost on TF-IDF matrix resulted in an accuracy of 0.94 and 0.92 for AF and HF, respectively. There were 211 mismatches between algorithm and ICD codes. One hundred and three were due to a difference in data availability or differing definitions. In the remaining 108 mismatches, 70% were due to incorrect labelling by the algorithm and 30% were due to erroneous ICD coding (2% of total hospitalizations). A newly developed NLP algorithm attained a high accuracy for classifying disease in medical records. XGBoost outperformed the deep learning technique BioBERT. NLP algorithms could be used to identify ICD-coding errors and optimize and support the ICD-coding process.Keywords
Funding Information
- Horizons 2020 (848056)
- Flanders Research Foundation FWO (1SE1222N)
This publication has 15 references indexed in Scilit:
- Automated ICD coding for primary diagnosis via clinically interpretable machine learningInternational Journal of Medical Informatics, 2021
- Automatic ICD-10 Coding and Training System: Deep Neural Network Based on Supervised LearningJMIR Medical Informatics, 2021
- Natural language processing for the assessment of cardiovascular disease comorbidities: The cardio‐Canary comorbidity projectClinical Cardiology, 2021
- Construction of a semi-automatic ICD-10 coding systemBMC Medical Informatics and Decision Making, 2020
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic ReviewJMIR Medical Informatics, 2019
- Diagnostic accuracy of the International Classification of Diseases, Tenth Revision, codes of heart failure in an administrative databasePharmacoepidemiology and Drug Safety, 2018
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- ICD-10: History and ContextAmerican Journal of Neuroradiology, 2016
- Systematic review of discharge coding accuracyJournal of Public Health, 2011