TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation
Top Cited Papers
Open Access
- 14 September 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1007-1014
Abstract
Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong generalization through In-context Learning, which involves phrasing the recommendation task as prompts. Nevertheless, the performance of LLMs in recommendation tasks remains suboptimal due to a substantial disparity between the training tasks for LLMs and recommendation tasks, as well as inadequate recommendation data during pre-training. To bridge the gap, we consider building a Large Recommendation Language Model by tunning LLMs with recommendation data. To this end, we propose an efficient and effective Tuning framework for Aligning LLMs with Recommendations, namely TALLRec. We have demonstrated that the proposed TALLRec framework can significantly enhance the recommendation capabilities of LLMs in the movie and book domains, even with a limited dataset of fewer than 100 samples. Additionally, the proposed framework is highly efficient and can be executed on a single RTX 3090 with LLaMA-7B. Furthermore, the fine-tuned LLM exhibits robust cross-domain generalization. Our code and data are available at https://github.com/SAI990323/TALLRec.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- MV-RNN: A Multi-View Recurrent Neural Network for Sequential RecommendationIEEE Transactions on Knowledge and Data Engineering, 2018
- Perceive Your Users in Depth2018
- Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding2018
- Sequential User-based Recurrent Neural Network Recommendations2017
- Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation2016
- Learning Hierarchical Representation Model for NextBasket Recommendation2015
- Factorizing personalized Markov chains for next-basket recommendation2010
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Learning and adaptivity in interactive recommender systems2007
- Improving recommendation lists through topic diversification2005