Evolving Gaussian Systems as a Framework for Federated Regression Problems
Open Access
- 22 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 33 (10) , 3736-3746
Abstract
In this paper, we present a novel federated learning framework to multivariate regression problems, termed Evolving Gaussian Federated Regression (eGauss+$_{FR}$). The need for a federated approach is due to the increasing problem of distributed acquisition of the data and protection for the rights of distributing these data. Regression problems are usually nonlinear and therefore strongly connected to the clustering to divide the data space into smaller sub-spaces where a linear approximation could be applied. Here we are faced with the main drawback of traditional clustering methods, where a predefined number of clusters is needed. In federated learning problems, where the data is commonly non-identically distributed between different sources or clients, this represents a significant challenge. This problem can be overcome by introducing an evolving approach which add and removes the clusters on-the-fly. The idea in our approach is to use the incremental c-regression or c-varieties clustering method to define the clusters which lie close to the lines and describe them with the centers and the covariance matrices. The clustering is done for each data source or client. Due to the restriction and protection of data sharing, only the centers and the covariance matrices of all clients are then transmitted to main server and merged together, which is here done in a way as proposed in eGauss+ method. From merged clusters the auxiliary points are generated, which than serve to approximate the function by using classical fuzzy models. Our proposed method was demonstrated on simple synthetic data, while synthetic and real-world datasets were used to test time complexity and scalability with the number of clients. The results demonstrate the benefits of evolving federated method, which results in high quality approximation of the function and can be easily extended to high-dimensional problems.Keywords
Funding Information
- Javna agencija za znanstvenoraziskovalno in inovacijsko dejavnost Republike Slovenije - ARIS, Slovenian Research and Innovation Agency - ARIS (P2-0219 (B))
This publication has 42 references indexed in Scilit:
- Increasing trust in AI through privacy preservation and model explainability: Federated Learning of Fuzzy Regression TreesInformation Fusion, 2024
- Federated learning meets remote sensingExpert Systems with Applications, 2024
- Evolving multi-user fuzzy classifier systems integrating human uncertainty and expert knowledgeInformation Sciences, 2022
- A privacy-preserving and non-interactive federated learning scheme for regression training with gradient descentInformation Sciences, 2021
- New Approaches to Federated XGBoost Learning for Privacy-Preserving Data Analysis2020
- A review of applications in federated learningComputers & Industrial Engineering, 2020
- Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A SurveyInformation Sciences, 2019
- Asynchronous Federated Learning for Geospatial Applications2019
- Explaining classifier decisions linguistically for stimulating and improving operators labeling behaviorInformation Sciences, 2017
- Fuzzy confidence interval for pH titration curveApplied Mathematical Modelling, 2011