Behavior-Dependent Linear Recurrent Units for Efficient Sequential Recommendation
Open Access
- 21 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1430-1440
Abstract
Sequential recommender systems aims to predict the users' next interaction through user behavior modeling with various operators like RNNs and attentions. However, existing models generally fail to achieve the three golden principles for sequential recommendation simultaneously, i.e., training efficiency, low-cost inference, and strong performance. To this end, we propose RecBLR, an Efficient Sequential Recommendation Model based on Behavior-Dependent Linear Recurrent Units to accomplish the impossible triangle of the three principles. By incorporating gating mechanisms and behavior-dependent designs into linear recurrent units, our model significantly enhances user behavior modeling and recommendation performance. Furthermore, we unlock the parallelizable training as well as inference efficiency for our model by designing a hardware-aware scanning acceleration algorithm with a customized CUDA kernel. Extensive experiments on real-world datasets with varying lengths of user behavior sequences demonstrate RecBLR's remarkable effectiveness in simultaneously achieving all three golden principles - strong recommendation performance, training efficiency, and low-cost inference, while exhibiting excellent scalability to datasets with long user interaction histories.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Contrastive Learning for Sequential Recommendation2022
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) networkPhysica D: Nonlinear Phenomena, 2020
- A Study on Catastrophic Forgetting in Deep LSTM Networks2019
- Self-Attentive Sequential Recommendation2018
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences, 2017
- Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation2016
- Deep Residual Learning for Image Recognition2016
- Image-Based Recommendations on Styles and Substitutes2015
- Friendship and mobility2011
- Factorizing personalized Markov chains for next-basket recommendation2010