AI Computing Systems for Large Language Models Training
- 1 January 2025
- journal article
- survey
- Published by Springer Nature in Journal of Computer Science and Technology
- Vol. 40 (1) , 6-41
Abstract
No abstract availableKeywords
This publication has 80 references indexed in Scilit:
- Monkey: Image Resolution and Text Label are Important Things for Large Multi-Modal Models2024
- Multimodal Large Language Models: A Survey2023
- Performance Characterization of Large Language Models on High-Speed Interconnects2023
- AI Computing Systems2023
- Compute Express Link®: An open industry-standard interconnect enabling heterogeneous data-centric computing2022
- A survey of transformersAI Open, 2022
- Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers2021
- Fixed-Point Back-Propagation Training2020
- DeepFreeze: Towards Scalable Asynchronous Checkpointing of Deep Learning Models2020
- Training high-performance and large-scale deep neural networks with full 8-bit integersNeural Networks, 2020