Weight Prediction Boosts the Convergence of AdamW
Author:
- 27 May 2023
- book chapter
- Published by Springer Nature
- p. 329-340
Abstract
No abstract availableKeywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Scaled ReLU Matters for Training Vision TransformersProceedings of the AAAI Conference on Artificial Intelligence, 2022
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Densely Connected Convolutional Networks2017
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Long short-term memory neural network for traffic speed prediction using remote microwave sensor dataTransportation Research Part C: Emerging Technologies, 2015
- Some methods of speeding up the convergence of iteration methodsUSSR Computational Mathematics and Mathematical Physics, 1964