Heterogeneous Defect Prediction Based on Federated Reinforcement Learning via Gradient Clustering
Open Access
- 29 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 87832-87843
Abstract
Heterogeneous defect prediction (HDP) refers to using heterogeneous data collected by other projects to build a defect prediction model to predict the software defects in a project. Traditional methods usually involve the measurement of the source project and the target project. However, due to the limitations of laws and regulations, these original data are not easy to obtain, which forms a data island. As a new machine learning paradigm, federated learning (FL) has great advantages in training heterogeneous data and data island. In order to solve the data island and data heterogeneity of HDP, we propose a novel Federated Reinforcement Learning via Gradient Clustering (FRLGC) method in this paper. Firstly, the parameters of the global model are transferred to each dueling deep Q network (dueling DQN) model and each client uses private data to train the dueling model which combines experience replay to increase data efficiency in limited datasets. Secondly, gaussian differential privacy is used to encrypt the model parameters to ensure the privacy and security of the model. Finally, we cluster the clients according to their locally encrypted model parameters and use weighted average to aggregate to create a new global model locally and globally. Experiments on nine projects in three public databases (Relink, NASA and AEEEM) show that FRLGC is superior to the relevant HDP solutions.Keywords
Funding Information
- Reserved Leaders of Heilongjiang Provincial Leading Talent Echelon, in 2021
This publication has 31 references indexed in Scilit:
- A Comparative Study to Benchmark Cross-Project Defect Prediction ApproachesIEEE Transactions on Software Engineering, 2017
- Kernel CCA Based Transfer Learning for Software Defect PredictionIEICE Transactions on Information and Systems, 2017
- Fuzzy Rule-Based Approach for Software Fault PredictionIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016
- Three-way decisions based software defect predictionKnowledge-Based Systems, 2016
- Heterogeneous cross-company defect prediction by unified metric representation and CCA-based transfer learning2015
- Human-level control through deep reinforcement learningNature, 2015
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- Data Quality: Some Comments on the NASA Software Defect DatasetsIEEE Transactions on Software Engineering, 2013
- Experience Replay for Real-Time Reinforcement Learning ControlIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2011
- Cross-project defect prediction2009