Machine Learning–Based Prediction of Suicidality in Adolescents With Allergic Rhinitis: Derivation and Validation in 2 Independent Nationwide Cohorts
Authors:
Open Access
- 14 February 2024
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e51473
Abstract
Background: Given the additional risk of suicide-related behaviors in adolescents with allergic rhinitis (AR), it is important to use the growing field of machine learning (ML) to evaluate this risk. Objective: This study aims to evaluate the validity and usefulness of an ML model for predicting suicide risk in patients with AR. Methods: We used data from 2 independent survey studies, Korea Youth Risk Behavior Web-based Survey (KYRBS; n=299,468) for the original data set and Korea National Health and Nutrition Examination Survey (KNHANES; n=833) for the external validation data set, to predict suicide risks of AR in adolescents aged 13 to 18 years, with 3.45% (10,341/299,468) and 1.4% (12/833) of the patients attempting suicide in the KYRBS and KNHANES studies, respectively. The outcome of interest was the suicide attempt risks. We selected various ML-based models with hyperparameter tuning in the discovery and performed an area under the receiver operating characteristic curve (AUROC) analysis in the train, test, and external validation data. Results: The study data set included 299,468 (KYRBS; original data set) and 833 (KNHANES; external validation data set) patients with AR recruited between 2005 and 2022. The best-performing ML model was the random forest model with a mean AUROC of 84.12% (95% CI 83.98%-84.27%) in the original data set. Applying this result to the external validation data set revealed the best performance among the models, with an AUROC of 89.87% (sensitivity 83.33%, specificity 82.58%, accuracy 82.59%, and balanced accuracy 82.96%). While looking at feature importance, the 5 most important features in predicting suicide attempts in adolescent patients with AR are depression, stress status, academic achievement, age, and alcohol consumption. Conclusions: This study emphasizes the potential of ML models in predicting suicide risks in patients with AR, encouraging further application of these models in other conditions to enhance adolescent health and decrease suicide rates.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- National trends in depression and suicide attempts and COVID-19 pandemic-related factors, 1998–2021: A nationwide study in South KoreaAsian Journal of Psychiatry, 2023
- Machine learning-based prediction of suicidality in adolescents during the COVID-19 pandemic (2020–2021): Derivation and validation in two independent nationwide cohortsAsian Journal of Psychiatry, 2023
- National Trends in Sadness, Suicidality, and COVID-19 Pandemic–Related Risk Factors Among South Korean Adolescents From 2005 to 2021JAMA Network Open, 2023
- National trends in alcohol and substance use among adolescents from 2005 to 2021: a Korean serial cross-sectional study of one million adolescentsWorld Journal of Pediatrics, 2023
- Integration of Face-to-Face Screening With Real-time Machine Learning to Predict Risk of Suicide Among AdultsJAMA Network Open, 2022
- The use of machine learning in the study of suicidal and non-suicidal self-injurious thoughts and behaviors: A systematic reviewJournal of Affective Disorders, 2019
- Mental Health in Allergic Rhinitis: Depression and Suicidal BehaviorCurrent Treatment Options in Allergy, 2017
- Effects of Lactobacillus rhamnosus on allergic march model by suppressing Th2, Th17, and TSLP responses via CD4+CD25+Foxp3+ TregsClinical Immunology, 2014
- Sleep impairment and daytime sleepiness in patients with allergic rhinitis: the role of congestion and inflammationAnnals of Allergy, Asthma & Immunology, 2013
- Mood-worsening with high-pollen-counts and seasonality: A preliminary reportJournal of Affective Disorders, 2007