JMJie Meng

Jie Meng

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jie Meng has a total of 5 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Fast Federated Learning Frameworks, Driven by Powerball Function and Hypergradient Descent

    by Jie Meng, Xi Chen, Zhuang Yang, Qiong Wu, Xizhao Luo

    Federated learning (FL), a paradigm of distributed machine learning, aims to utilize user data for model training while safeguarding data privacy. However, numerous challenges arise in practical applications. Among these, accelerating the training rate and improving the generalization performance of FL models are particularly noteworthy challenges. Recent studies are particularly about understanding the role of stochastic optimization in federated optimization, leading to various fast federated optimization algorithms. As a special case, some studies have explored treating the sum of local differences as pseudo-gradients and also introduced the global learning rate. To deal with the challenge, this work develops fast federated optimization algorithms from the perspective of the Powerball function and the hypergradient descent, coined FedPBHD, extending the family of federated optimization algorithms. Different from existing FL algorithms, FedPBHD renews the update direction by using the discretization’s of ordinary differential equations (ODEs). Besides, FedPBHD utilizes an adaptive update rule of the learning rate (an extremely crucial hyperparameter for FL algorithms). The convergence performance of FedPBHD has been established through a rigorous theoretical analysis. Finally, we compare our FedPBHD algorithms against numerous benchmark optimizers for different practical applications of computer vision, natural language processing under both independent identically distribution (IID) and non-IID conditions. Experimental results on different problems have shown encouraging performance of the novel Federated optimization algorithms.