SemAlignRec: A Large Language Model-Driven Cross-Modal Collaborative–Semantic Recommendation Framework
- 23 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. PP (5) , 1-12
Abstract
Recommender systems are increasingly vital in e-commerce and social media, yet traditional collaborative filtering and deep learning methods still face challenges in fine-grained interest modeling and data sparsity. Large language models (LLMs), with strong semantic understanding and reasoning capabilities, excel in cold-start and long-tail scenarios. However, the modality gap between low-dimensional collaborative signals and LLMs’ contextual embeddings leads to fusion difficulties and semantic distortion. To address this, we propose SemAlignRec, a unified recommendation framework that enhances fusion through a model-agnostic collaborative–semantic alignment mechanism. Specifically: 1) deep semantic encoding and graph structural enhancement: leveraging LLMs to encode user and item textual attributes into high-quality semantic embeddings, which are further refined by a multilayer deep semantic encoder; a graph enhancement module incorporating residual connections, node attention, and graph perturbations strengthens collaborative embeddings and facilitates their fusion with semantic embeddings; and 2) transmodal fusion and self-supervised optimization: integrating multihead attention, gated fusion, and contrastive self-supervision to achieve precise fusion of collaborative and semantic embeddings. Experiments on multiple datasets show that SemAlignRec delivers substantial performance gains, achieving an overall average improvement of about 6.6% over the compared baselines. In particular, compared with the latest baseline DALR, SemAlignRec obtains an average gain of approximately 9.8% on key metrics for the Amazon and Yelp datasets, demonstrating its strong practical potential.Keywords
Funding Information
- Shandong Provincial Natural Science Foundation and in part by the projects of the Key Laboratory of Computing Power Network and Information Security, Ministry of Education (2023ZD028)
This publication has 44 references indexed in Scilit:
- CoLLM: Integrating Collaborative Embeddings Into Large Language Models for RecommendationIEEE Transactions on Knowledge and Data Engineering, 2025
- Cross-Modal Knowledge Diffusion-Based Generation for Difference-Aware Medical VQAIEEE Transactions on Image Processing, 2025
- A survey on large language models for recommendationWorld Wide Web, 2024
- Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation2024
- Recommender Systems in the Era of Large Language Models (LLMs)IEEE Transactions on Knowledge and Data Engineering, 2024
- LightGCN2020
- Variational Autoencoders for Collaborative Filtering2018
- Controlling Popularity Bias in Learning-to-Rank Recommendation2017
- Deep Residual Learning for Image Recognition2016
- Advances in Collaborative Filtering2015