SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 23-35
Abstract
Sanghoon Kim, Dahyun Kim, Chanjun Park, Wonsung Lee, Wonho Song, Yunsu Kim, Hyeonwoo Kim, Yungi Kim, Hyeonju Lee, Jihoo Kim, Changbae Ahn, Seonghoon Yang, Sukyung Lee, Hyunbyung Park, Gyoungjin Gim, Mikyoung Cha, Hwalsuk Lee, Sunghun Kim. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track). 2024.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Instruction Tuning for Large Language Models: A SurveyACM Computing Surveys, 2026
- Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Models2025
- Evalverse: Unified and Accessible Library for Large Language Model Evaluation2024
- Investigating Data Contamination in Modern Benchmarks for Large Language Models2024
- Large language models (LLM) and ChatGPT: what will the impact on nuclear medicine be?European Journal of Nuclear Medicine and Molecular Imaging, 2023
- Reusing Pretrained Models by Multi-linear Operators for Efficient Training2023
- No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models2023
- NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark2023
- Self-Instruct: Aligning Language Models with Self-Generated Instructions2023
- Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models2022