Knowledge Graph-Enhanced Masked Auto-Encoders for Recommendation Systems
- 13 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. 18 (6) , 3946-3958
Abstract
Contrastive learning has received significant attention for its ability to improve the representation quality over limited labeled data, achieving notable advancements in Knowledge graphs (KGs) enhanced recommendation. However, the effectiveness of most contrastive methods heavily relies on manually designed data augmentation strategies, which often limit their generality across different datasets and downstream tasks, as well as their robustness to noise perturbations. To address these challenges, we propose a novel KG-enhanced recommendation framework named Knowledge Graph-enhanced Masked Auto-Encoders for Collaborative Filtering (KG-CMAE) based on the masking-reconstruction paradigm, which employs two types of masked auto-encoders: the Knowledge Masked Auto-Encoder (KMAE) and the Collaborative Masked Auto-Encoder (CMAE), to adaptively extract informative self-supervised signals from KGs and user-item interactions. Specifically, KMAE employs the multi-head cross-attention mechanism to reflect the importance of neighboring nodes, and selectively masks and reconstructs the important connections with high structural consistency, thereby highlighting task-relevant knowledge. CMAE focuses on masking and reconstructing the interactions with high semantic relevance in the user-item interaction graph, and incorporates an enhanced decoder to better model the direct collaborative signals, such as user-user and item-item correlations, to mitigate the over-smoothing problem. Extensive experiments are conducted on three benchmark datasets under various settings, including noisy data, cold-start user recommendation, and long-tail item recommendation. The experimental results demonstrate the effectiveness, generality and robustness of the proposed KG-CMAE model compared to various baseline methods.Keywords
Funding Information
- National Natural Science Foundation of China (62172324)
- National Natural Science Foundation of China (62272379)
- National Natural Science Foundation of China (62102310)
- Xixian New Area Science and Technology Plan Project (RGZN-2023-002)
- Xixian New Area Science and Technology Plan Project (2022-ZDJS-001)
- China Postdoctoral Science Foundation (2020M683689XB)
- Youth Innovation Team of Shaanxi Universities (2019-38)
- Project of Zigong Science and Technology Bureau (2022XDHZ-XAJD-01)
This publication has 38 references indexed in Scilit:
- A Survey on Accuracy-oriented Neural Recommendation: From Collaborative Filtering to Information-rich RecommendationIEEE Transactions on Knowledge and Data Engineering, 2022
- A Survey on Knowledge Graph-Based Recommender SystemsIEEE Transactions on Knowledge and Data Engineering, 2020
- KGAT2019
- Deep Interest Network for Click-Through Rate Prediction2018
- Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model2018
- Collaborative Knowledge Base Embedding for Recommender Systems2016
- Collaborative Denoising Auto-Encoders for Top-N Recommender Systems2016
- Factorization Machines2010
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Amazon.com recommendations: item-to-item collaborative filteringIEEE Internet Computing, 2003