Calendar Graph Neural Networks for Modeling Time Structures in Spatiotemporal User Behaviors
Authors:
- Daheng WangDWDaheng Wang
- Meng JiangMJMeng Jiang
- Munira SyedMSMunira Syed
- Oliver ConwayOCOliver Conway
- Vishal JunejaVJVishal Juneja
- Sriram SubramanianSSSriram Subramanian
- Nitesh V. ChawlaNCNitesh V. Chawla
Preprint
Abstract
User behavior modeling is important for industrial applications such as demographic attribute prediction, content recommendation, and target advertising. Existing methods represent behavior log as a sequence of adopted items and find sequential patterns; however, concrete location and time information in the behavior log, reflecting dynamic and periodic patterns, joint with the spatial dimension, can be useful for modeling users and predicting their characteristics. In this work, we propose a novel model based on graph neural networks for learning user representations from spatiotemporal behavior data. A behavior log comprises a sequence of sessions; and a session has a location, start time, end time, and a sequence of adopted items. Our model's architecture incorporates two networked structures. One is a tripartite network of items, sessions, and locations. The other is a hierarchical calendar network of hour, week, and weekday nodes. It first aggregates embeddings of location and items into session embeddings via the tripartite network, and then generates user embeddings from the session embeddings via the calendar structure. The user embeddings preserve spatial patterns and temporal patterns of a variety of periodicity (e.g., hourly, weekly, and weekday patterns). It adopts the attention mechanism to model complex interactions among the multiple patterns in user behaviors. Experiments on real datasets (i.e., clicks on news articles in a mobile app) show our approach outperforms strong baselines for predicting missing demographic attributes.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Structured Sequence Modeling with Graph Convolutional Recurrent Networks2018
- Graph Convolutional Neural Networks for Web-Scale Recommender Systems2018
- Multi-Type Itemset Embedding for Learning Behavior Success2018
- Session-aware Information Embedding for E-commerce Product Recommendation2017
- Neural Attentive Session-based Recommendation2017
- When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation2017
- Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs2017
- Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations2016
- Using neural word embeddings to model user behavior and detect user segmentsKnowledge-Based Systems, 2016
- Web-scale user modeling for targeting2012