Disentangled Self-Supervision in Sequential Recommenders
Authors:
Top Cited Papers
Open Access
- 20 August 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 483-491
Abstract
To learn a sequential recommender, the existing methods typically adopt the sequence-to-item (seq2item) training strategy, which supervises a sequence model with a user's next behavior as the label and the user's past behaviors as the input. The seq2item strategy, however, is myopic and usually produces non-diverse recommendation lists. In this paper, we study the problem of mining extra signals for supervision by looking at the longer-term future. There exist two challenges: i) reconstructing a future sequence containing many behaviors is exponentially harder than reconstructing a single next behavior, which can lead to difficulty in convergence, and ii) the sequence of all future behaviors can involve many intentions, not all of which may be predictable from the sequence of earlier behaviors. To address these challenges, we propose a sequence-to-sequence (seq2seq) training strategy based on latent self-supervision and disentanglement. Specifically, we perform self-supervision in the latent space, i.e., reconstructing the representation of the future sequence as a whole, instead of reconstructing the items in the future sequence individually. We also disentangle the intentions behind any given sequence of behaviors and construct seq2seq training samples using only pairs of sub-sequences that involve a shared intention. Results on real-world benchmarks and synthetic data demonstrate the improvement brought by seq2seq training.Keywords
This publication has 34 references indexed in Scilit:
- Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification2016
- Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles2016
- Colorful Image Colorization2016
- Vista2016
- A Dynamic Recurrent Model for Next Basket Recommendation2016
- Collaborative Deep Learning for Recommender Systems2015
- Learning Hierarchical Representation Model for NextBasket Recommendation2015
- Item-based top-Nrecommendation algorithmsACM Transactions on Information Systems, 2004
- Item-based collaborative filtering recommendation algorithms2001
- GroupLens1994