Abstract
Contrastive learning has received significant attention for its ability to improve the representation quality over limited labeled data, achieving notable advancements in Knowledge graphs (KGs) enhanced recommendation. However, the effectiveness of most contrastive methods heavily relies on manually designed data augmentation strategies, which often limit their generality across different datasets and downstream tasks, as well as their robustness to noise perturbations. To address these challenges, we propose a novel KG-enhanced recommendation framework named Knowledge Graph-enhanced Masked Auto-Encoders for Collaborative Filtering (KG-CMAE) based on the masking-reconstruction paradigm, which employs two types of masked auto-encoders: the Knowledge Masked Auto-Encoder (KMAE) and the Collaborative Masked Auto-Encoder (CMAE), to adaptively extract informative self-supervised signals from KGs and user-item interactions. Specifically, KMAE employs the multi-head cross-attention mechanism to reflect the importance of neighboring nodes, and selectively masks and reconstructs the important connections with high structural consistency, thereby highlighting task-relevant knowledge. CMAE focuses on masking and reconstructing the interactions with high semantic relevance in the user-item interaction graph, and incorporates an enhanced decoder to better model the direct collaborative signals, such as user-user and item-item correlations, to mitigate the over-smoothing problem. Extensive experiments are conducted on three benchmark datasets under various settings, including noisy data, cold-start user recommendation, and long-tail item recommendation. The experimental results demonstrate the effectiveness, generality and robustness of the proposed KG-CMAE model compared to various baseline methods.
Funding Information
  • National Natural Science Foundation of China (62172324)
  • National Natural Science Foundation of China (62272379)
  • National Natural Science Foundation of China (62102310)
  • Xixian New Area Science and Technology Plan Project (RGZN-2023-002)
  • Xixian New Area Science and Technology Plan Project (2022-ZDJS-001)
  • China Postdoctoral Science Foundation (2020M683689XB)
  • Youth Innovation Team of Shaanxi Universities (2019-38)
  • Project of Zigong Science and Technology Bureau (2022XDHZ-XAJD-01)

This publication has 38 references indexed in Scilit: