A consensus-based decentralized training algorithm for deep neural networks with communication compression
Authors:
- Bo LiuBLBo Liu
- Zhengtao DingZDZhengtao Ding
- 1 June 2021
- journal article
- research article
- Published by Elsevier in Neurocomputing
- Vol. 440, 287-296
Abstract
No abstract availableKeywords
This publication has 20 references indexed in Scilit:
- Recent Trends in Deep Learning Based Natural Language Processing [Review Article]IEEE Computational Intelligence Magazine, 2018
- On Nonconvex Decentralized Gradient DescentIEEE Transactions on Signal Processing, 2018
- Computational intelligence approaches for classification of medical data: State-of-the-art, future challenges and research directionsNeurocomputing, 2018
- Fast convergent distributed cooperative learning algorithms over networksNeurocomputing, 2018
- Who Moved My Data? Privacy Protection in SmartphonesIEEE Communications Magazine, 2017
- Fog Computing: Helping the Internet of Things Realize Its PotentialComputer, 2016
- A decentralized training algorithm for Echo State Networks in distributed big data applicationsNeural Networks, 2016
- The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]IEEE Signal Processing Magazine, 2012
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Consensus Problems in Networks of Agents With Switching Topology and Time-DelaysIEEE Transactions on Automatic Control, 2004