Transition Propagation Graph Neural Networks for Temporal Networks
- 18 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35 (4) , 4567-4579
Abstract
Researchers of temporal networks (e.g., social networks and transaction networks) have been interested in mining dynamic patterns of nodes from their diverse interactions. Inspired by recently powerful graph mining methods like skip-gram models and graph neural networks (GNNs), existing approaches focus on generating temporal node embeddings sequentially with nodes’ sequential interactions. However, the sequential modeling of previous approaches cannot handles the transition structure between nodes’ neighbors with limited memorization capacity. In detail, an effective method for the transition structures is required to both model nodes’ personalized patterns adaptively and capture node dynamics accordingly. In this article, we propose a method, namely transition propagation graph neural networks (TIP-GNN), to tackle the challenges of encoding nodes’ transition structures. The proposed TIP-GNN focuses on the bilevel graph structure in temporal networks: besides the explicit interaction graph, a node’s sequential interactions can also be constructed as a transition graph. Based on the bilevel graph, TIP-GNN further encodes transition structures by multistep transition propagation and distills information from neighborhoods by a bilevel graph convolution. Experimental results over various temporal networks reveal the efficiency of our TIP-GNN, with at most 7.2% improvements of accuracy on temporal link prediction. Extensive ablation studies further verify the effectiveness and limitations of the transition propagation module. Our code is available at https://github.com/doujiang-zheng/TIP-GNN.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (U20B2066, 61976186)
- Starry Night Science Fund of Zhejiang University Shanghai Institute for Advanced Study (SN-ZJU-SIAS-001)
- Fundamental Research Funds for the Central Universities (226-2022-00064)
This publication has 30 references indexed in Scilit:
- A Comprehensive Survey on Graph Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks2019
- Neural Graph Collaborative Filtering2019
- Embedding Temporal Network via Neighborhood Formation2018
- Graph embedding techniques, applications, and performance: A surveyKnowledge-Based Systems, 2018
- Continuous-Time Dynamic Network Embeddings2018
- node2vec2016
- LINE2015
- DeepWalk2014
- An Effective Network Traffic Classification Method with Unknown Flow DetectionIEEE Transactions on Network and Service Management, 2013