Privacy-Preserving Federated Model Predicting Bipolar Transition in Patients With Depression: Prediction Model Development Study (Preprint)
Authors:
- Dong Yun LeeDLDong Yun Lee
- Byungjin ChoiBCByungjin Choi
- Chungsoo KimCKChungsoo Kim
- Egill FridgeirssonEFEgill Fridgeirsson
- Jenna RepsJRJenna Reps
- Myoungsuk KimMKMyoungsuk Kim
- Jihyeong KimJKJihyeong Kim
- Jae-Won JangJJJae-Won Jang
- Sang Youl RheeSRSang Youl Rhee
- Won-Woo SeoWSWon-Woo Seo
- Seunghoon LeeSLSeunghoon Lee
- Sang Joon SonSSSang Joon Son
Preprint
- 1 February 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Mood disorder has emerged as a serious concern for public health; in particular, bipolar disorder has a less favorable prognosis than depression. Although prompt recognition of depression conversion to bipolar disorder is needed, early prediction is challenging due to overlapping symptoms. Recently, there have been attempts to develop a prediction model by using federated learning. Federated learning in medical fields is a method for training multi-institutional machine learning models without patient-level data sharing. OBJECTIVE This study aims to develop and validate a federated, differentially private multi-institutional bipolar transition prediction model. METHODS This retrospective study enrolled patients diagnosed with the first depressive episode at 5 tertiary hospitals in South Korea. We developed models for predicting bipolar transition by using data from 17,631 patients in 4 institutions. Further, we used data from 4541 patients for external validation from 1 institution. We created standardized pipelines to extract large-scale clinical features from the 4 institutions without any code modification. Moreover, we performed feature selection in a federated environment for computational efficiency and applied differential privacy to gradient updates. Finally, we compared the federated and the 4 local models developed with each hospital's data on internal and external validation data sets. RESULTS In the internal data set, 279 out of 17,631 patients showed bipolar disorder transition. In the external data set, 39 out of 4541 patients showed bipolar disorder transition. The average performance of the federated model in the internal test (area under the curve [AUC] 0.726) and external validation (AUC 0.719) data sets was higher than that of the other locally developed models (AUC 0.642-0.707 and AUC 0.642-0.699, respectively). In the federated model, classifications were driven by several predictors such as the Charlson index (low scores were associated with bipolar transition, which may be due to younger age), severe depression, anxiolytics, young age, and visiting months (the bipolar transition was associated with seasonality, especially during the spring and summer months). CONCLUSIONS We developed and validated a differentially private federated model by using distributed multi-institutional psychiatric data with standardized pipelines in a real-world environment. The federated model performed better than models using local data only.Keywords
All Related Versions
- Published version: Journal of Medical Internet Research, 25, e46165.
This publication has 28 references indexed in Scilit:
- Deep Learning with Differential Privacy2016
- Chronobiology of Bipolar Disorder: Therapeutic ImplicationCurrent Psychiatry Reports, 2015
- Seasonality and bipolar disorder: A systematic review, from admission rates to seasonality of symptomsJournal of Affective Disorders, 2014
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- Mania With and Without Depression in a Community Sample of US AdolescentsArchives of General Psychiatry, 2012
- Adaptation and validation of the Charlson Index for Read/OXMIS coded databasesBMC Family Practice, 2010
- An ‘Honest Broker’ mechanism to maintain privacy for patient care and academic medical researchInternational Journal of Medical Informatics, 2007
- The bipolar spectrumThe British Journal of Psychiatry, 2007
- Indicators of Mania in Depressed OutpatientsThe Journal of Clinical Psychiatry, 2007
- Risk for Bipolar Illness in Patients Initially Hospitalized for Unipolar DepressionAmerican Journal of Psychiatry, 2001