Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear Model
Authors:
- 31 January 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 29 (6) , 1254-1267
Abstract
With the rapid growth of Internet applications, sequential prediction in collaborative filtering has become an emerging and crucial task. Given the behavioral history of a specific user, predicting his or her next choice plays a key role in improving various online services. Meanwhile, there are more and more scenarios with multiple types of behaviors, while existing works mainly study sequences with a single type of behavior. As a widely used approach, Markov chain based models are based on a strong independence assumption. As two classical neural network methods for modeling sequences, recurrent neural networks cannot well model short-term contexts, and the log-bilinear model is not suitable for long-term contexts. In this paper, we propose a Recurrent Log-BiLinear (RLBL) model. It can model multiple types of behaviors in historical sequences with behavior-specific transition matrices. RLBL applies a recurrent structure for modeling long-term contexts. It models several items in each hidden layer and employs position-specific transition matrices for modeling short-term contexts. Moreover, considering continuous time difference in behavioral history is a key factor for dynamic prediction, we further extend RLBL and replace position-specific transition matrices with time-specific transition matrices, and accordingly propose a Time-Aware Recurrent Log-BiLinear (TA-RLBL) model. Experimental results show that the proposed RLBL model and TA-RLBL model yield significant improvements over the competitive compared methods on three datasets, i.e., Movielens-1M dataset, Global Terrorism Database and Tmall dataset with different numbers of behavior types.Keywords
All Related Versions
Funding Information
- National key research and development program (2016YFB1001000)
- National Natural Science Foundation of China (61403390, U1435221)
- CCF-Tencent Open Fund
- CCF-Venustech Hongyan Research Fund
This publication has 26 references indexed in Scilit:
- Forecasting Fine-Grained Air Quality Based on Big Data2015
- Learning Hierarchical Representation Model for NextBasket Recommendation2015
- Neural Responding Machine for Short-Text Conversation2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocolsUser Modeling and User-Adapted Interaction, 2013
- Factorization Machines with libFMACM Transactions on Intelligent Systems and Technology, 2012
- Advances in Collaborative Filtering2010
- Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorization2010
- Collaborative filtering with temporal dynamicsCommunications of the ACM, 2010
- Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot ExperimentPLOS Computational Biology, 2008