Impact of ICD10 and secular changes on electronic medical record rheumatoid arthritis algorithms
Authors:
Open Access
- 1 December 2020
- journal article
- research article
- Published by Oxford University Press (OUP) in Rheumatology
- Vol. 59 (12) , 3759-3766
Abstract
Objective: The objective of this study was to compare the performance of an RA algorithm developed and trained in 2010 utilizing natural language processing and machine learning, using updated data containing ICD10, new RA treatments, and a new electronic medical records (EMR) system. Methods: We extracted data from subjects with ≥1 RA International Classification of Diseases (ICD) codes from the EMR of two large academic centres to create a data mart. Gold standard RA cases were identified from reviewing a random 200 subjects from the data mart, and a random 100 subjects who only have RA ICD10 codes. We compared the performance of the following algorithms using the original 2010 data with updated data: (i) a published 2010 RA algorithm; (ii) updated algorithm, incorporating ICD10 RA codes and new DMARDs; and (iii) published algorithm using ICD codes only, ICD RA code ≥3. Results: The gold standard RA cases had mean age 65.5 years, 78.7% female, 74.1% RF or antibodies to cyclic citrullinated peptide (anti-CCP) positive. The positive predictive value (PPV) for ≥3 RA ICD was 54%, compared with 56% in 2010. At a specificity of 95%, the PPV of the 2010 algorithm and the updated version were both 91%, compared with 94% (95% CI: 91, 96%) in 2010. In subjects with ICD10 data only, the PPV for the updated 2010 RA algorithm was 93%. Conclusion: The 2010 RA algorithm validated with the updated data with similar performance characteristics as the 2010 data. While the 2010 algorithm continued to perform better than the rule-based approach, the PPV of the latter also remained stable over time.Keywords
Funding Information
- National Institutes of Health (P30-AR072577, T32-AR007530)
This publication has 24 references indexed in Scilit:
- Association between low density lipoprotein and rheumatoid arthritis genetic factors with low density lipoprotein levels in rheumatoid arthritis and non-rheumatoid arthritis controlsAnnals of the Rheumatic Diseases, 2014
- Automatic Prediction of Rheumatoid Arthritis Disease Activity from the Electronic Medical RecordsPLOS ONE, 2013
- Associations of autoantibodies, autoimmune risk alleles, and clinical diagnoses from the electronic medical records in rheumatoid arthritis cases and non–rheumatoid arthritis controlsArthritis & Rheumatism, 2012
- Identification of rheumatoid arthritis patients using an administrative database: A Veterans Affairs studyArthritis Care & Research, 2012
- Portability of an algorithm to identify rheumatoid arthritis in electronic health recordsJournal of the American Medical Informatics Association, 2012
- Validation of rheumatoid arthritis diagnoses in health care utilization dataArthritis Research & Therapy, 2011
- Genetic Basis of Autoantibody Positive and Negative Rheumatoid Arthritis Risk in a Multi-ethnic Cohort Derived from Electronic Health RecordsThe American Journal of Human Genetics, 2011
- Electronic medical records for discovery research in rheumatoid arthritisArthritis Care & Research, 2010
- Anti–tumor necrosis factor α therapy and the risk of serious bacterial infections in elderly patients with rheumatoid arthritisArthritis & Rheumatism, 2007
- Accuracy of veterans administration databases for a diagnosis of rheumatoid arthritisArthritis Care & Research, 2004