Efficient Cold-Start Recommendation via BPE Token-Level Embedding Initialization with LLM
Preprint
Abstract
The cold-start issue is the challenge when we talk about recommender systems, especially in the case when we do not have the past interaction data of new users or new items. Content-based features or hybrid solutions are common as conventional solutions, but they can only work in a sparse metadata environment with shallow patterns. In this paper, the efficient cold-start recommendation strategy is presented, which is based on the sub word-level representations by applying Byte Pair Encoding (BPE) tokenization and pre-trained Large Language Model (LLM) embedding in the initialization procedure. We obtain fine-grained token-level vectors that are aligned with the BPE vocabulary as opposed to using coarse-grained sentence embeddings. Together, these token embeddings can be used as dense semantic priors on unseen entities, making immediate recommendation performance possible without user-item interaction history. Our mechanism can be compared to collaborative filtering systems and tested over benchmark datasets with stringent cold-start assumptions. Experimental findings show that the given BPE-LLM method achieves higher Recall@k, NDCG@k, and Hit Rate measurements compared to the standard baseline and displays the same capability of sufficient computational performance. Furthermore, we demonstrate that using subword-aware embeddings yields better generalizability and is more interpretable, especially within a multilingual and sparse input setting. The practical application of token-level semantic initialization as a lightweight, but nevertheless effective extension to modern recommender systems in the zero-shot setting is indicated within this work.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Meta-Learning for Cold-Start Personalization in Prompt-Tuned LLMs2025
- Self-Supervised User Embedding Alignment for Cross-Domain Recommendations Via Multi-LLM Co-training2025
- RLHF Fine-Tuning of LLMs for Alignment with Implicit User Feedback in Conversational Recommenders2025
- LLM-Augmented Symptom Analysis for Cardiovascular Disease Risk Prediction: A Clinical NLP Approach2025
- Decoding student cognitive abilities: a comparative study of explainable AI algorithms in educational data miningScientific Reports, 2025
- Research on Model Parallelism and Data Parallelism Optimization Methods in Large Language Model—Based Recommendation Systems2025
- Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems2025
- Deep Learning Model Acceleration and Optimization Strategies for Real-Time Recommendation Systems2025
- Research on the Design of a Short Video Recommendation System Based on Multimodal Information and Differential Privacy2025
- A Multimodal Fusion Network for Student Emotion Recognition Based on Transformer and Tensor Product2024