Can a Novel Natural Language Processing Model and Artificial Intelligence Automatically Generate Billing Codes From Spine Surgical Operative Notes?
Open Access
- 18 March 2023
- journal article
- research article
- Published by SAGE Publications in Global Spine Journal
- Vol. 14 (7) , 2022-2030
Abstract
Study Design: Retrospective cohort. Objective: Billing and coding-related administrative tasks are a major source of healthcare expenditure in the United States. We aim to show that a second-iteration Natural Language Processing (NLP) machine learning algorithm, XLNet, can automate the generation of CPT codes from operative notes in ACDF, PCDF, and CDA procedures. Methods: We collected 922 operative notes from patients who underwent ACDF, PCDF, or CDA from 2015 to 2020 and included CPT codes generated by the billing code department. We trained XLNet, a generalized autoregressive pretraining method, on this dataset and tested its performance by calculating AUROC and AUPRC. Results: The performance of the model approached human accuracy. Trial 1 (ACDF) achieved an AUROC of .82 (range: .48-.93), an AUPRC of .81 (range: .45-.97), and class-by-class accuracy of 77% (range: 34%-91%); trial 2 (PCDF) achieved an AUROC of .83 (.44-.94), an AUPRC of .70 (.45-.96), and class-by-class accuracy of 71% (42%-93%); trial 3 (ACDF and CDA) achieved an AUROC of .95 (.68-.99), an AUPRC of .91 (.56-.98), and class-by-class accuracy of 87% (63%-99%); trial 4 (ACDF, PCDF, CDA) achieved an AUROC of .95 (.76-.99), an AUPRC of .84 (.49-.99), and class-by-class accuracy of 88% (70%-99%). Conclusions: We show that the XLNet model can be successfully applied to orthopedic surgeon’s operative notes to generate CPT billing codes. As NLP models as a whole continue to improve, billing can be greatly augmented with artificial intelligence assisted generation of CPT billing codes which will help minimize error and promote standardization in the process.Keywords
This publication has 14 references indexed in Scilit:
- Comparison of machine-learning algorithms for the prediction of Current Procedural Terminology (CPT) codes from pathology reportsJournal of Pathology Informatics, 2022
- Classification of Current Procedural Terminology Codes from Electronic Health Record Data Using Machine LearningAnesthesiology, 2020
- What Should Health Care Organizations Do to Reduce Billing Fraud and Abuse?AMA Journal of Ethics, 2020
- An empirical evaluation of deep learning for ICD-9 code assignment using MIMIC-III clinical notesComputer Methods and Programs in Biomedicine, 2019
- Detecting medical prescriptions suspected of fraud using an unsupervised data mining algorithmDARU Journal of Pharmaceutical Sciences, 2018
- Administrative Costs Associated With Physician Billing and Insurance-Related Activities at an Academic Health Care SystemJAMA, 2018
- Big Data in Medicine Is Driving Big ChangesYearbook of Medical Informatics, 2014
- US Physician Practices Versus Canadians: Spending Nearly Four Times As Much Money Interacting With PayersHealth Affairs, 2011
- Peering Into The Black Box: Billing And Insurance Activities In A Medical GroupHealth Affairs, 2009
- The Cost Of Health Insurance Administration In California: Estimates For Insurers, Physicians, And HospitalsHealth Affairs, 2005