Ruizhe Yu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ruizhe Yu has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Huijun Di
Beijing Institute of Technology
1 shared publication - Lihua Lu
Shandong Massive Information Technology Research Institute, Jinan, China
1 shared publication - Lin Zhang
Beijing Laboratory of Intelligent Information Technology, School of Computer Science, Beijing Institute of Technology, Beijing, China
1 shared publication - Shunzhou Wang
School of Computer Science and Technology, Beijing Institute of Technology, 47833 Beijing China
1 shared publication - Yao Lu
Beijing Institute of Technology
1 shared publication
Latest Publications
- 23 July 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 22 (2) , 524-539
GAIM: Graph Attention Interaction Model for Collective Activity Recognition
Unbalanced interaction relationships at personal and group levels play a pivotal role in collective activity recognition, which have not been adaptively and jointly explored by previous approaches. In this work, we propose a graph attention interaction model (GAIM) embedded with the graph attention block (GAB) to explicitly and adaptively infer unbalanced interaction relations at personal and group levels in a unified architecture, and further to learn the spatial and temporal evolutions of the collective activity from these interactions to predict the activity labels. We first design the spatio-temporal graphs tailored to the collective activity where the concurrent person and group nodes respectively represent individuals' actions and the collective activity. The graphs provide both spatial structures and semantic appearance features for the collective activity. Then GAB performs convolution-like filters on the graphs to infer unequal and two-level interaction relations in the collective activity by implementing graph convolutional networks (GCNs) with a shared attention mechanism. At the personal level, the GAB learns different levels of interactions for each person node from its neighbor person nodes under the guidance from the group node. At the group level, the GAB assesses various degrees of interactions to the group node contributed by person nodes. Equipped with the GRUs network, the GAIM learns the spatial and temporal evolutions of individuals' actions as well as the collective activity from the captured interactions, and finally predicts the label of the collective activity. Experiments on four publicly available datasets and ablation studies are conducted to evaluate the performance of our GAIM, and the improved performance demonstrates the effectiveness of our model.
- 23 July 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 22 (2) , 524-539
GAIM: Graph Attention Interaction Model for Collective Activity Recognition
Unbalanced interaction relationships at personal and group levels play a pivotal role in collective activity recognition, which have not been adaptively and jointly explored by previous approaches. In this work, we propose a graph attention interaction model (GAIM) embedded with the graph attention block (GAB) to explicitly and adaptively infer unbalanced interaction relations at personal and group levels in a unified architecture, and further to learn the spatial and temporal evolutions of the collective activity from these interactions to predict the activity labels. We first design the spatio-temporal graphs tailored to the collective activity where the concurrent person and group nodes respectively represent individuals' actions and the collective activity. The graphs provide both spatial structures and semantic appearance features for the collective activity. Then GAB performs convolution-like filters on the graphs to infer unequal and two-level interaction relations in the collective activity by implementing graph convolutional networks (GCNs) with a shared attention mechanism. At the personal level, the GAB learns different levels of interactions for each person node from its neighbor person nodes under the guidance from the group node. At the group level, the GAB assesses various degrees of interactions to the group node contributed by person nodes. Equipped with the GRUs network, the GAIM learns the spatial and temporal evolutions of individuals' actions as well as the collective activity from the captured interactions, and finally predicts the label of the collective activity. Experiments on four publicly available datasets and ablation studies are conducted to evaluate the performance of our GAIM, and the improved performance demonstrates the effectiveness of our model.