TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation
Authors:
- Keqin BaoKBKeqin Bao
- Jizhi ZhangJZJizhi Zhang
- Yang ZhangYZYang Zhang
- Wenjie WangWWWenjie Wang
- Fuli FengFFFuli Feng
- Xiangnan HeXHXiangnan He
Preprint
Abstract
Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong generalization through In-context Learning, which involves phrasing the recommendation task as prompts. Nevertheless, the performance of LLMs in recommendation tasks remains suboptimal due to a substantial disparity between the training tasks for LLMs and recommendation tasks, as well as inadequate recommendation data during pre-training. To bridge the gap, we consider building a Large Recommendation Language Model by tunning LLMs with recommendation data. To this end, we propose an efficient and effective Tuning framework for Aligning LLMs with Recommendation, namely TALLRec. We have demonstrated that the proposed TALLRec framework can significantly enhance the recommendation capabilities of LLMs in the movie and book domains, even with a limited dataset of fewer than 100 samples. Additionally, the proposed framework is highly efficient and can be executed on a single RTX 3090 with LLaMA-7B. Furthermore, the fine-tuned LLM exhibits robust cross-domain generalization. Our code and data are available at https://github.com/SAI990323/TALLRec.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Contrastive Learning for Sequential Recommendation2022
- Long- and short-term self-attention network for sequential recommendationNeurocomputing, 2021
- CosRec: 2D Convolutional Neural Networks for Sequential Recommendation2019
- A Simple Convolutional Generative Network for Next Item Recommendation2019
- MV-RNN: A Multi-View Recurrent Neural Network for Sequential RecommendationIEEE Transactions on Knowledge and Data Engineering, 2018
- Self-Attentive Sequential Recommendation2018
- Perceive Your Users in Depth2018
- Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding2018
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Improving recommendation lists through topic diversification2005