Automatic International Classification of Diseases Coding System: Deep Contextualized Language Model With Rule-Based Approaches (Preprint)
Authors:
- Pei-Fu ChenPCPei-Fu Chen
- Kuan-Chih ChenKCKuan-Chih Chen
- Wei-Chih LiaoWLWei-Chih Liao
- Feipei LaiFLFeipei Lai
- Tai-Liang HeTHTai-Liang He
- Sheng-Che LinSLSheng-Che Lin
- Wei-Jen ChenWCWei-Jen Chen
- Chi-Yu YangCYChi-Yu Yang
- Yu-Cheng LinYLYu-Cheng Lin
- I-Chang TsaiITI-Chang Tsai
- Chi-Hao ChiuCCChi-Hao Chiu
- Shu-Chih ChangSCShu-Chih Chang
Preprint
- 25 February 2022
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND The tenth revision of the International Classification of Diseases (ICD-10) is widely used for epidemiological research and health management. The clinical modification (CM) and procedure coding system (PCS) of ICD-10 were developed to describe more clinical details with increasing diagnosis and procedure codes and applied in disease-related groups for reimbursement. The expansion of codes made the coding time-consuming and less accurate. The state-of-the-art model using deep contextual word embeddings was used for automatic multilabel text classification of ICD-10. In addition to input discharge diagnoses (DD), the performance can be improved by appropriate preprocessing methods for the text from other document types, such as medical history, comorbidity and complication, surgical method, and special examination. OBJECTIVE This study aims to establish a contextual language model with rule-based preprocessing methods to develop the model for ICD-10 multilabel classification. METHODS We retrieved electronic health records from a medical center. We first compared different word embedding methods. Second, we compared the preprocessing methods using the best-performing embeddings. We compared biomedical bidirectional encoder representations from transformers (BioBERT), clinical generalized autoregressive pretraining for language understanding (Clinical XLNet), label tree-based attention-aware deep model for high-performance extreme multilabel text classification (AttentionXLM), and word-to-vector (Word2Vec) to predict ICD-10-CM. To compare different preprocessing methods for ICD-10-CM, we included DD, medical history, and comorbidity and complication as inputs. We compared the performance of ICD-10-CM prediction using different preprocesses, including definition training, external cause code removal, number conversion, and combination code filtering. For the ICD-10 PCS, the model was trained using different combinations of DD, surgical method, and key words of special examination. The micro F1 score and the micro area under the receiver operating characteristic curve were used to compare the model’s performance with that of different preprocessing methods. RESULTS BioBERT had an F1 score of 0.701 and outperformed other models such as Clinical XLNet, AttentionXLM, and Word2Vec. For the ICD-10-CM, the model had an F1 score that significantly increased from 0.749 (95% CI 0.744-0.753) to 0.769 (95% CI 0.764-0.773) with the ICD-10 definition training, external cause code removal, number conversion, and combination code filter. For the ICD-10-PCS, the model had an F1 score that significantly increased from 0.670 (95% CI 0.663-0.678) to 0.726 (95% CI 0.719-0.732) with a combination of discharge diagnoses, surgical methods, and key words of special examination. With our preprocessing methods, the model had the highest area under the receiver operating characteristic curve of 0.853 (95% CI 0.849-0.855) and 0.831 (95% CI 0.827-0.834) for ICD-10-CM and ICD-10-PCS, respectively. CONCLUSIONS The performance of our model with the pretrained contextualized language model and rule-based preprocessing method is better than that of the state-of-the-art model for ICD-10-CM or ICD-10-PCS. This study highlights the importance of rule-based preprocessing methods based on coder coding rules.Keywords
All Related Versions
- Published version: JMIR Medical Informatics, 10 (6), e37557.
This publication has 12 references indexed in Scilit:
- Automatic Medical Code Assignment via Deep Learning Approach for Intelligent HealthcareIEEE Journal of Biomedical and Health Informatics, 2020
- A narrative review of the impact of the transition to ICD-10 and ICD-10-CM/PCSJAMIA Open, 2019
- Learning unsupervised contextual representations for medical synonym discoveryJAMIA Open, 2019
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- A method for modeling co-occurrence propensity of clinical codes with application to ICD-10-PCS auto-codingJournal of the American Medical Informatics Association, 2016
- Accuracy of clinician-clinical coder information handover following acute medical admissions: implication for using administrative datasets in clinical outcomes managementJournal of Public Health, 2015
- Automated methods for the summarization of electronic health recordsJournal of the American Medical Informatics Association, 2015
- Impact of the Transition to ICD-10 on Medicare Inpatient Hospital PaymentsMedicare & Medicaid Research Review, 2011
- International classification of diseases, 10th edition, clinical modification and procedure coding system: descriptive overview of the next generation HIPAA code setsJournal of the American Medical Informatics Association, 2010
- Natural language processingAnnual Review of Information Science and Technology, 2003