Distributed sequential federated learning
Preprint
Abstract
The analysis of data stored in multiple sites has become more popular, raising new concerns about the security of data storage and communication. Federated learning, which does not require centralizing data, is a common approach to preventing heavy data transportation, securing valued data, and protecting personal information protection. Therefore, determining how to aggregate the information obtained from the analysis of data in separate local sites has become an important statistical issue. The commonly used averaging methods may not be suitable due to data nonhomogeneity and incomparable results among individual sites, and applying them may result in the loss of information obtained from the individual analyses. Using a sequential method in federated learning with distributed computing can facilitate the integration and accelerate the analysis process. We develop a data-driven method for efficiently and effectively aggregating valued information by analyzing local data without encountering potential issues such as information security and heavy transportation due to data communication. In addition, the proposed method can preserve the properties of classical sequential adaptive design, such as data-driven sample size and estimation precision when applied to generalized linear models. We use numerical studies of simulated data and an application to COVID-19 data collected from 32 hospitals in Mexico, to illustrate the proposed method.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- COVID-19 and Asthma: Reflection During the PandemicClinical Reviews in Allergy & Immunology, 2020
- Federated Learning: Challenges, Methods, and Future DirectionsIEEE Signal Processing Magazine, 2020
- Active learning in multiple-class classification problems via individualized binary modelsComputational Statistics & Data Analysis, 2020
- Communication-Efficient Distributed Statistical InferenceJournal of the American Statistical Association, 2018
- Differentially Private Distributed Online LearningIEEE Transactions on Knowledge and Data Engineering, 2018
- Sequential estimate for linear regression models with uncertain number of effective variablesMetrika, 2013
- Sequential Experimentation in Clinical Trials2013
- Distributed Autonomous Online Learning: Regrets and Intrinsic Privacy-Preserving PropertiesIEEE Transactions on Knowledge and Data Engineering, 2012
- Sequential estimation in generalized linear models when covariates are subject to errorsMetrika, 2009
- Strong consistency of maximum quasi-likelihood estimate in generalized linear models via a last timeStatistics & Probability Letters, 1999