Temporal Drift in the Semantic Meaning of Pediatric Anxiety Terms in Electronic Healthcare Records
Preprint
Abstract
: Objective: To identify and measure semantic drift (i.e., the change in semantic meaning over time) in expert-provided anxiety-related (AR) terminology and compare it to other common electronic health record (EHR) vocabulary in longitudinal clinical notes. Methods: Computational methods were used to investigate semantic drift in a pediatric clinical note corpus from 2009 to 2022. First, we measured the semantic drift of a word using the similarity of temporal word embeddings. Second, we analyzed how a word’s contextual meaning evolved over successive years by examining its nearest neighbors. Third, we investigated the Laws of Semantic Change to measure frequency and polysemy. Words were categorized as AR or common EHR vocabulary. Results: 98% of the AR terminology maintained a cosine similarity score of 0.00 – 0.50; at least 90% of common EHR vocabulary maintained a cosine similarity score of 0.00 – 0.25. Laws of Semantic Change indicated that frequently occurring vocabulary words remained contextually stable (Frequency Coefficient = 0.04); however, words with multiple meanings, such as abbreviations, did not show the same stability (Polysemy Coefficient = 0.630). The semantic change over time within the AR terminology was slower on average than the semantic change within the common EHR vocabulary (Type Coefficient = -0.179); this was further validated by interacting the year and Type (Coef = -0.09 – -0.523). Conclusions: The semantic meaning of anxiety terms remains stable within our dataset, indicating slower overall semantic drift compared to common EHR vocabulary. However, failure to capture nuanced changes may impact the accuracy and reliability of clinical decision support systems over time.Keywords
This publication has 20 references indexed in Scilit:
- Effects of the COVID-19 pandemic on mental health, anxiety, and depressionBMC Psychology, 2023
- Assessing the effects of data drift on the performance of machine learning models used in clinical sepsis predictionInternational Journal of Medical Informatics, 2022
- Lexical Stability of Psychiatric Clinical Notes from Electronic Health Records over a DecademedRxiv, 2022
- An overview of clinical decision support systems: benefits, risks, and strategies for successnpj Digital Medicine, 2020
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- The DSM‐5: Classification and criteria changesWorld Psychiatry, 2013
- Anxiety Disorders in Children and AdolescentsCurrent Problems in Pediatric and Adolescent Health Care, 2010
- Pediatric Anxiety — Underrecognized and UndertreatedNew England Journal of Medicine, 2008
- A Brief Measure for Assessing Generalized Anxiety DisorderArchives of internal medicine (1960), 2006
- A Generalized Solution of the Orthogonal Procrustes ProblemPsychometrika, 1966