A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation
Preprint
Abstract
Sequential recommendation is one of fundamental tasks for Web applications. Previous methods are mostly based on Markov chains with a strong Markov assumption. Recently, recurrent neural networks (RNNs) are getting more and more popular and has demonstrated its effectiveness in many tasks. The last hidden state is usually applied as the sequence's representation to make recommendation. Benefit from the natural characteristics of RNN, the hidden state is a combination of long-term dependency and short-term interest to some degrees. However, the monotonic temporal dependency of RNN impairs the user's short-term interest. Consequently, the hidden state is not sufficient to reflect the user's final interest. In this work, to deal with this problem, we propose a Hierarchical Contextual Attention-based GRU (HCA-GRU) network. The first level of HCA-GRU is conducted on the input. We construct a contextual input by using several recent inputs based on the attention mechanism. This can model the complicated correlations among recent items and strengthen the hidden state. The second level is executed on the hidden state. We fuse the current hidden state and a contextual hidden state built by the attention mechanism, which leads to a more suitable user's overall interest. Experiments on two real-world datasets show that HCA-GRU can effectively generate the personalized ranking list and achieve significant improvement.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Crafting GBD-Net for Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Global Context-Aware Attention LSTM Networks for 3D Action Recognition2017
- Episodic CAMN: Contextual Attention-Based Memory Networks with Iterative Feedback for Scene Labeling2017
- Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear ModelIEEE Transactions on Knowledge and Data Engineering, 2017
- Context-Aware Sequential Recommendation2016
- Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation2016
- Spatio-Temporal LSTM with Trust Gates for 3D Human Action Recognition2016
- Factorizing personalized Markov chains for next-basket recommendation2010
- Three new graphical models for statistical language modelling2007
- Learning long-term dependencies with gradient descent is difficultIEEE Transactions on Neural Networks, 1994