Identifying long-term conditions in New Zealand general practice using structured and unstructured data: a cross-sectional study
Open Access
- 22 May 2025
- journal article
- Published by BMJ in BMJ Health & Care Informatics
- Vol. 32 (1) , e101393
Abstract
Objectives: This study examined whether incorporating free-text entries into structured general practice records improves the detection of long-term conditions (LTCs) and multimorbidity (MM) in New Zealand (NZ) general practices. Methods: Data from 374 071 deidentified individuals in general practices were analysed to identify 61 LTCs. Structured data were extracted using Read codes from a national master list, and clinical raters independently identified condition-related free-text, including synonyms, negation terms and common misspellings in randomised samples. Keywords were categorised and refined through ten iterative tests. Programmatic text classification was developed and assessed against gold-standard clinician ratings, using sensitivity, specificity, positive predictive value (PPV) and F 1 -score. Results: A quarter of general practitioner classifications contained either unrecognised Read codes or consisted of free-text only. Clinician inter-rater reliability was high (kappa ≥0.9). Compared with clinical gold standard, text classification yielded an average sensitivity of 88%, specificity of 99% and PPV of 95%, with an F 1 -score range of 82%–95%. Incorporating free text increased LTC prevalence from 42.1% to 46.3%, reducing misclassification of MM diagnoses by identifying 12 626 additional patients with MM and 15 972 additional patients with at least one LTC. Discussion: In the course of workflow, general practitioners face barriers to accurate LTC coding or may simply annotate with text-based descriptions. Programmatic text classification has demonstrated high performance and identified many more patients receiving LTC care. Conclusions: Combining structured and unstructured data optimises MM detection in NZ general practices and has the potential to improve case management, follow-up care and allocation of healthcare resources.Keywords
Funding Information
- National Heart Foundation of New Zealand (1866)
- Health Research Council of New Zealand (20/304)
- Health Research Council of New Zealand (21/712)
- New Zealand College of Public Health Medicine (Not Applicable)
This publication has 20 references indexed in Scilit:
- The impact of multimorbidity on people's lives: a cross-sectional survey2018
- Epidemiology of multimorbidity in New Zealand: a cross-sectional study using national-level hospital and pharmaceutical dataBMJ Open, 2018
- Is general practice identification of prior cardiovascular disease at the time of CVD risk assessment accurate and does it matter?2018
- The new measuring multimorbidity index predicted mortality better than Charlson and Elixhauser indices among the general populationJournal of Clinical Epidemiology, 2017
- Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort studyBMJ, 2017
- Chronic disease prevalence from Italian administrative databases in the VALORE project: a validation through comparison of population estimates with general practice databases and national surveyBMC Public Health, 2013
- Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional studyThe Lancet, 2012
- The prevalence of multimorbidity in primary care and its effect on health care utilization and costFamily Practice, 2011
- Comparing manual and automated coding of physicians quality reporting initiative measures in an ambulatory EHR.2010
- Lack of Agreement in Pediatric Emergency Department Discharge Diagnoses from Clinical and Administrative Data SourcesAcademic Emergency Medicine, 2007