Diff4Rec: Sequential Recommendation with Curriculum-scheduled Diffusion Augmentation
Open Access
- 26 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 9329-9335
Abstract
Sequential recommender systems often suffer from performance drops due to the data-sparsity issue in real-world scenarios. To address this issue, we bravely take advantage of the strength in diffusion model to conduct data augmentation for sequential recommendation in this paper. However, there remain two critical challenges for this scarcely-explored topic: (i) previous diffusion models are mostly designed for image generation aiming to capture pixel patterns, which can hardly be applied in data augmentation for sequential recommendation aiming to capture the user-item relations; (ii) given a specific diffusion model capable of user-item interaction augmentation, it is non-trivial to guarantee that the diffusion-generated data can always bring benefits towards the sequential recommendation model. To tackle these challenges, we propose Diff4Rec, a curriculum-scheduled diffusion augmentation framework for sequential recommendation. Specifically, a diffusion model is pre-trained on recommendation data via corrupting and reconstructing the user-item interactions in the latent space, and the generated predictions are leveraged to produce diversified augmentations for the sparse user-item interactions. Subsequently, a curriculum scheduling strategy is designed to progressively feed the diffusion-generated samples into the sequential recommenders, with respect to two levels, i.e., interaction augmentation and objective augmentation, to jointly optimize the data and model. Extensive experiments demonstrate that our proposed Diff4Rec framework is able to effectively achieve superior performance over several strong baselines, capable of making high-quality and robust sequential recommendations. We believe the proposed Diff4Rec has the promising potential to bring paradigm shift in multimedia recommendation.Keywords
Funding Information
- National Key Research and Development Program of China (No.2022ZD0115903)
- Beijing Key Lab of Networked Multimedia
- National Natural Science Foundation of China (No. 62222209, 62250008, 62102222)
- Beijing National Research Center For Information Science And Technology (No. BNR2023RC01003, BNR2023TD03006)
This publication has 29 references indexed in Scilit:
- Self-Attentive Sequential Recommendation2018
- Recurrent Neural Networks with Top-k Gains for Session-based Recommendations2018
- Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding2018
- Variational Autoencoders for Collaborative Filtering2018
- Neural Attentive Session-based Recommendation2017
- Neural Collaborative Filtering2017
- Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation2016
- Learning Hierarchical Representation Model for NextBasket Recommendation2015
- Factorizing personalized Markov chains for next-basket recommendation2010
- Curriculum learning2009