Foundations of Large Language Models
Authors:
Preprint
Abstract
This is a book about large language models. As indicated by the title, it primarily focuses on foundational concepts rather than comprehensive coverage of all cutting-edge technologies. The book is structured into four main chapters, each exploring a key area: pre-training, generative models, prompting techniques, and alignment methods. It is intended for college students, professionals, and practitioners in natural language processing and related fields, and can serve as a reference for anyone interested in large language models.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Human Language Understanding & ReasoningDaedalus, 2022
- The Web as a Knowledge-Base for Answering Complex Questions2018
- Learning to Rank for Information Retrieval and Natural Language ProcessingSynthesis Lectures on Human Language Technologies, 2011
- Learning to Rank for Information RetrievalFoundations and Trends® in Information Retrieval, 2009
- The Analysis of PermutationsJournal of the Royal Statistical Society Series C: Applied Statistics, 1975
- Prediction and Entropy of Printed EnglishBell System Technical Journal, 1951