Comparing Machine and Deep Learning Models for Pediatric Anxiety Classification using Structured EHRs and Area-based Measures of Health Data
Preprint
Abstract
Objective: This study investigates the performance of various machine learning (ML) and deep learning (DL) models to classify pediatric patients at risk of anxiety disorders using electronic health records (EHRs). By leveraging EHR data and including Area-based measures of health (ABMH) data, this approach aims to enable proactive care by monitoring potential anxiety onset comprehensively across various age groups. Methods: In this study, we trained a series of ML and DL models to classify youth at risk of developing anxiety disorders. ML models (Logistic Regression, Decision Tree, Random Forest, K-Nearest Neighbors, XGBoost) and DL models (LSTM, GRU, RETAIN, Dipole) were trained using structured EHR data from 30-day periods before anxiety diagnoses. Two datasets per age group were used: one with structured EHR data only and another with incorporating both structured EHR and ABMH data. Model performance was assessed using accuracy, the AUROC, AUPRC, PPV, NPV, and F1 scores. Results: The ML models provided a solid performance baseline, with XGBoost showing strong baseline performance across age groups, with AUROC scores of 0.817 (structured EHR) and 0.816 (structured EHR + ABMH). Between DL models, RETAIN and Dipole performed the best. For example, RETAIN achieved AUROC scores of 0.851 (structured EHR) and 0.853 (structured + ABMH), while Dipole scored 0.853 and 0.857, respectively, for 8-year-olds. These results underscore the viability of both ML and DL models for the early detection of pediatric anxiety disorders. Conclusion: This study comprehensively investigated ML and DL models for diagnosing pediatric anxiety. We demonstrated that ML and DL models can effectively monitor probable anxiety onset within an EHR system and also with the ABMH data. We discovered that model performance varied with age, indicating the need for personalized model development per age group for effective clinical predictive analytics.Keywords
This publication has 56 references indexed in Scilit:
- Depression and Suicide Risk ScreeningJAMA, 2023
- Screening for Pediatric Anxiety DisordersJAMA, 2022
- Preventive psychiatry: a blueprint for improving the mental health of young peopleWorld Psychiatry, 2021
- Deep learning for Alzheimer prediction using brain biomarkersArtificial Intelligence Review, 2021
- Deep LSTM Recurrent Neural Network for Anxiety Classification from EEG in Adolescents with Autism2020
- A systematic review: machine learning based recommendation systems for e-learningEducation and Information Technologies, 2019
- Naturalistic Follow-up of Youths Treated for Pediatric Anxiety DisordersJAMA Psychiatry, 2014
- Clinical Utility of Machine Learning and Longitudinal EHR Data2013
- Incidence and Risk Patterns of Anxiety and Depressive Disorders and Categorization of Generalized Anxiety DisorderArchives of General Psychiatry, 2010
- Lifetime Prevalence and Age-of-Onset Distributions of DSM-IV Disorders in the National Comorbidity Survey ReplicationArchives of General Psychiatry, 2005