Application of Clinical Department–Specific AI-Assisted Coding Using Taiwan Diagnosis-Related Groups: Retrospective Validation Study
Open Access
- 12 February 2025
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 12 (1) , e59961
Abstract
Background: The accuracy of the ICD-10-CM (International Classification of Diseases, Tenth Revision, Clinical Modification) procedure coding system (PCS) is crucial for generating correct Taiwan diagnosis-related groups (DRGs), as coding errors can lead to financial losses for hospitals. Objective: The study aimed to determine the consistency between an artificial intelligence (AI)-assisted coding module and manual coding, as well as to identify clinical specialties suitable for implementing the developed AI-assisted coding module. Methods: This study examined the AI-assisted coding module from the perspective of health care professionals. The research period started in February 2023. The study excluded cases outside of Taiwan DRGs, those with incomplete medical records, and cases with Taiwan DRG disposals ICD-10 (International Statistical Classification of Diseases, Tenth Revision) PCS. Data collection was conducted through retrospective medical record review. The AI-assisted module was constructed using a hierarchical attention network. The verification of the Taiwan DRGs results from the AI-assisted coding model focused on the major diagnostic categories (MDCs). Statistical computations were conducted using SPSS version 19. Research variables consisted of categorical variables represented by MDC, and continuous variables were represented by the relative weight of Taiwan DRGs. Results: A total of 2632 discharge records meeting the research criteria were collected from February to April 2023. In terms of inferential statistics, κ statistics were used for MDC analysis. The infectious and parasitic diseases MDC, as well as the respiratory diseases MDC had κ values exceeding 0.8. Clinical inpatient specialties were statistically analyzed using the Wilcoxon signed rank test. There was not a difference in coding results between the 23 clinical departments, such as the Division of Cardiology, the Division of Nephrology, and the Department of Urology. Conclusions: For human coders, with the assistance of the ICD-10-CM AI-assisted coding system, work time is reduced. Additionally, strengthening knowledge in clinical documentation enables human coders to maximize their role. This positions them to become clinical documentation experts, preparing them for further career development. Future research will apply the same method to validate the ICD-10 AI-assisted coding module.Keywords
This publication has 24 references indexed in Scilit:
- Automating the overburdened clinical coding system: challenges and next stepsnpj Digital Medicine, 2023
- International Classification of Diseases clinical coding training: An international surveyHealth Information Management Journal, 2022
- Automated ICD coding for primary diagnosis via clinically interpretable machine learningInternational Journal of Medical Informatics, 2021
- The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performanceStrategic Management Journal, 2021
- Artificial intelligence, robotics, advanced technologies and human resource management: a systematic reviewThe International Journal of Human Resource Management, 2021
- Deep learning in clinical natural language processing: a methodical reviewJournal of the American Medical Informatics Association, 2019
- Computer-assisted clinical coding: A narrative review of the literature on its benefits, limitations, implementation and impact on clinical coding professionalsHealth Information Management Journal, 2019
- Financial implications of coding inaccuracies in patients undergoing elective endovascular abdominal aortic aneurysm repairJournal of Vascular Surgery, 2019
- A method for modeling co-occurrence propensity of clinical codes with application to ICD-10-PCS auto-codingJournal of the American Medical Informatics Association, 2016
- A context-aware approach for progression tracking of medical concepts in electronic medical recordsJournal of Biomedical Informatics, 2015