Socially-Aware Graph Convolutional Network for Human Trajectory Prediction
Authors:
- 1 March 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 325-333
Abstract
Learning to understand human behaviors and predict their trajectories is a prerequisite for an automated car to navigate through the crowd safely and efficiently. This problem is particularly challenging as it requires the car to jointly reason about multiple pedestrians in a scenario where every one cooperates with each other to avoid collisions. To model the interactions among them, we propose a socially-aware graph convolutional network (SAGCN) which solves this problem in a graph learning framework. An attention graph is first built where each of its node carries the pedestrian temporal information and its edge represents the correspondence between pairwise pedestrians. To extract the temporal features, we implement temporal convolutional network (TCN) on each node. By utilization of relative motion between pairwise pedestrians, another TCN is employed to learn the correspondence of them which is formulated to an adjacency matrix of the attention graph. With the learned temporal features and adjacency matrix, a graph convolutional network (GCN) is exploited to aggregate the node information and jointly predict future trajectories of multiple pedestrians. Through experiments in several publicly available datasets, we demonstrate that our model effectively learns the comprehensive spatial-temporal representation and outperforms state-of-art methods in terms of prediction accuracy.Keywords
This publication has 25 references indexed in Scilit:
- Understanding Collective Activitiesof People from VideosIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Socially-aware robot navigation: A learning approach2012
- Activity Forecasting2012
- Random field topic model for semantic region analysis in crowded scenes from tracklets2011
- Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Negotiating Constraints to the Adoption of Agent-Based Modeling in Tourism PlanningEnvironment and Planning B: Planning and Design, 2011
- Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings2010
- Crowds by ExampleComputer Graphics Forum, 2007
- Semantic-Based Surveillance Video RetrievalIEEE Transactions on Image Processing, 2007
- Social force model for pedestrian dynamicsPhysical Review E, 1995