Lexical stability of psychiatric clinical notes from electronic health records over a decade
Open Access
- 25 August 2023
- journal article
- research article
- Published by Cambridge University Press (CUP) in Acta Neuropsychiatrica
- Vol. 37, 1-11
Abstract
Objective: Natural language processing (NLP) methods hold promise for improving clinical prediction by utilising information otherwise hidden in the clinical notes of electronic health records. However, clinical practice – as well as the systems and databases in which clinical notes are recorded and stored – change over time. As a consequence, the content of clinical notes may also change over time, which could degrade the performance of prediction models. Despite its importance, the stability of clinical notes over time has rarely been tested. Methods: The lexical stability of clinical notes from the Psychiatric Services of the Central Denmark Region in the period from January 1, 2011, to November 22, 2021 (a total of 14,811,551 clinical notes describing 129,570 patients) was assessed by quantifying sentence length, readability, syntactic complexity and clinical content. Changepoint detection models were used to estimate potential changes in these metrics. Results: We find lexical stability of the clinical notes over time, with minor deviations during the COVID-19 pandemic. Out of 2988 data points, 17 possible changepoints (corresponding to 0.6%) were detected. The majority of these were related to the discontinuation of a specific note type. Conclusion: We find lexical and syntactic stability of clinical notes from psychiatric services over time, which bodes well for the use of NLP for predictive modelling in clinical psychiatry.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Monitoring of COVID-19 pandemic-related psychopathology using machine learningActa Neuropsychiatrica, 2022
- The PSYchiatric clinical outcome prediction (PSYCOP) cohort: leveraging the potential of electronic health records in the treatment of mental disordersActa Neuropsychiatrica, 2021
- Hard for humans, hard for machines: predicting readmission after psychiatric hospitalization using narrative notesTranslational Psychiatry, 2021
- An overview of clinical decision support systems: benefits, risks, and strategies for successnpj Digital Medicine, 2020
- Scalable and accurate deep learning with electronic health recordsnpj Digital Medicine, 2018
- Clinical information extraction applications: A literature reviewJournal of Biomedical Informatics, 2018
- Text mining applications in psychiatry: a systematic literature reviewInternational Journal of Methods in Psychiatric Research, 2015
- Improving the Electronic Health Record—Are Clinicians Getting What They Wished For?JAMA, 2013
- Optimal Detection of Changepoints With a Linear Computational CostJournal of the American Statistical Association, 2012
- Definition, structure, content, use and impacts of electronic health records: A review of the research literatureInternational Journal of Medical Informatics, 2008