Communication optimization strategies for distributed deep neural network training: A survey

This publication has 36 references indexed in Scilit:

• ImageNet Large Scale Visual Recognition Challenge
  International Journal of Computer Vision, 2015
• Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
  2014
• Bandwidth optimal all-reduce algorithms for clusters of workstations
  Journal of Parallel and Distributed Computing, 2009
• A scalable, commodity data center network architecture
  ACM SIGCOMM Computer Communication Review, 2008
• Gradient-based learning applied to document recognition
  Proceedings of the IEEE, 1998
• Long Short-Term Memory
  Neural Computation, 1997
• A bridging model for parallel computation
  Communications of the ACM, 1990
• Principal component analysis
  Chemometrics and Intelligent Laboratory Systems, 1987
• Learning representations by back-propagating errors
  Nature, 1986
• Universal codeword sets and representations of the integers
  IEEE Transactions on Information Theory, 1975