WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model Merging
Open Access
- 12 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 6342-6353
Abstract
Cross-Domain Sequential Recommendation (CDSR) seeks to improve user preference modeling by transferring knowledge from multiple domains. Despite the progress made in CDSR, most existing methods rely on overlapping users or items to establish cross-domain correlations-a requirement that rarely holds in real-world settings. The advent of large language models (LLM) and model-merging techniques appears to overcome this limitation by unifying multi-domain data without explicit overlaps. Yet, our empirical study shows that naively training an LLM on combined domains—or simply merging several domain-specific LLMs—often degrades performance relative to a model trained solely on the target domain. To address these challenges, we first experimentally investigate the cause of suboptimal performance in LLM-based cross-domain recommendation and model merging. Building on these insights, we introduce WeaveRec, which cross-trains multiple LoRA modules with source and target domain data in a ''weaving'' fashion, and fuses them via model merging. WeaveRec can be extended to multi-source domain scenarios and notably does not introduce additional inference-time cost in terms of latency or memory. Furthermore, we provide a theoretical guarantee that WeaveRec can reduce the upper bound of the expected error in the target domain. Extensive experiments on single-source, multi-source, and cross-platform cross-domain recommendation scenarios validate that WeaveRec effectively mitigates performance degradation and consistently outperforms baseline approaches in real?world recommendation tasks. Codes are available at https://github.com/mertell/WeaveRec.Keywords
All Related Versions
Funding Information
- National Science and Technology Major Project (2023ZD0121103)
- National Natural Science Foundation of China (62402159)
- National Natural Science Foundation of China (U23B2031)
- National Natural Science Foundation of China (72188101)
- Fundamental Research Funds for the Central Universities (PA2025IISL0105)
- Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China) (BigKEOpen2025-02)
This publication has 28 references indexed in Scilit:
- Making Non-Overlapping Matters: An Unsupervised Alignment Enhanced Cross-Domain Cold-Start RecommendationIEEE Transactions on Knowledge and Data Engineering, 2024
- Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders2023
- Towards Universal Cross-Domain Recommendation2023
- A Survey on Cross-domain Recommendation: Taxonomies, Methods, and Future DirectionsACM Transactions on Information Systems, 2022
- Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)2022
- Towards Universal Sequence Representation Learning for Recommender Systems2022
- Reinforcement Learning-enhanced Shared-account Cross-domain Sequential RecommendationIEEE Transactions on Knowledge and Data Engineering, 2022
- Filter-enhanced MLP is All You Need for Sequential Recommendation2022
- BERT4Rec2019
- Self-Attentive Sequential Recommendation2018