Ziliang Gan
Ziliang Gan has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Dong Zhang
HiThink Research, Hangzhou, China
2 shared publications - Haipang Wu
HiThink Research, Hangzhou, China
2 shared publications - Ji Liu
Baidu Inc., Beijing, China
2 shared publications - Lei Jin
Beijing University of Posts and Telecommunications, Beijing, China
2 shared publications - Rongjunchen Zhang
HiThink Research, Hangzhou, China
2 shared publications - Xiaojuan Wang
Beijing University of Posts and Telecommunications
2 shared publications
Latest Publications
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10787-10796
NEXUS-O: An Omni-Perceptive and -Interactive Model for Language, Audio, and Vision
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10787-10796
Open AccessNEXUS-O: An Omni-Perceptive and -Interactive Model for Language, Audio, and Vision
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12867-12874
MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12867-12874
Open AccessMME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning
- 22 March 2025
- Published by Springer Nature
- p. 132-142
Multi-level Fusion for Multi-modal Human Action Recognition
- 22 March 2025
- Published by Springer Nature
- p. 132-142
Multi-level Fusion for Multi-modal Human Action Recognition
- Open Access
- 30 May 2024
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 18 (7) , 888-906
SkatingVerse: A large‐scale benchmark for comprehensive evaluation on human action understanding
Human action understanding (HAU) is a broad topic that involves specific tasks, such as action localisation, recognition, and assessment. However, most popular HAU datasets are bound to one task based on particular actions. Combining different but relevant HAU tasks to establish a unified action understanding system is challenging due to the disparate actions across datasets. A large‐scale and comprehensive benchmark, namely SkatingVerse is constructed for action recognition, segmentation, proposal, and assessment. SkatingVerse focus on fine‐grained sport action, hence figure skating is chosen as the task object, which eliminates the biases of the object, scene, and space that exist in most previous datasets. In addition, skating actions have inherent complexity and similarity, which is an enormous challenge for current algorithms. A total of 1687 official figure skating competition videos was collected with a total of 184.4 h, exceeding four times over other datasets with a similar topic. SkatingVerse enables to formulate a unified task to output fine‐grained human action classification and assessment results from a raw figure skating competition video. In addition, SkatingVerse can facilitate the study of HAU foundation model due to its large scale and abundant categories. Moreover, image modality is incorporated for human pose estimation task into SkatingVerse . Extensive experimental results show that (1) SkatingVerse significantly helps the training and evaluation of HAU methods, (2) the performance of existing HAU methods has much room to improve, and SkatingVerse helps to reduce such gaps, and (3) unifying relevant tasks in HAU through a uniform dataset can facilitate more practical applications. SkatingVerse will be publicly available to facilitate further studies on relevant problems.
- 30 May 2024
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 18 (7) , 888-906
Open AccessSkatingVerse: A large‐scale benchmark for comprehensive evaluation on human action understanding
Human action understanding (HAU) is a broad topic that involves specific tasks, such as action localisation, recognition, and assessment. However, most popular HAU datasets are bound to one task based on particular actions. Combining different but relevant HAU tasks to establish a unified action understanding system is challenging due to the disparate actions across datasets. A large‐scale and comprehensive benchmark, namely SkatingVerse is constructed for action recognition, segmentation, proposal, and assessment. SkatingVerse focus on fine‐grained sport action, hence figure skating is chosen as the task object, which eliminates the biases of the object, scene, and space that exist in most previous datasets. In addition, skating actions have inherent complexity and similarity, which is an enormous challenge for current algorithms. A total of 1687 official figure skating competition videos was collected with a total of 184.4 h, exceeding four times over other datasets with a similar topic. SkatingVerse enables to formulate a unified task to output fine‐grained human action classification and assessment results from a raw figure skating competition video. In addition, SkatingVerse can facilitate the study of HAU foundation model due to its large scale and abundant categories. Moreover, image modality is incorporated for human pose estimation task into SkatingVerse . Extensive experimental results show that (1) SkatingVerse significantly helps the training and evaluation of HAU methods, (2) the performance of existing HAU methods has much room to improve, and SkatingVerse helps to reduce such gaps, and (3) unifying relevant tasks in HAU through a uniform dataset can facilitate more practical applications. SkatingVerse will be publicly available to facilitate further studies on relevant problems.
- Open Access
- 28 June 2023
- Published by MDPI AG in Electronics
- Vol. 12 (13) , 2852
Adaptive Multi-Scale Difference Graph Convolution Network for Skeleton-Based Action Recognition
Graph convolutional networks (GCNs) have obtained remarkable performance in skeleton-based action recognition. However, previous approaches fail to capture the implicit correlations between joints and handle actions across varying time intervals. To address these problems, we propose an adaptive multi-scale difference graph convolution Network (AMD-GCN), which comprises an adaptive spatial graph convolution module (ASGC) and a multi-scale temporal difference convolution module (MTDC). The first module is capable of acquiring data-dependent and channel-wise graphs that are adaptable to both samples and channels. The second module employs the multi-scale approach to model temporal information across a range of time scales. Additionally, the MTDC incorporates an attention-enhanced module and difference convolution to accentuate significant channels and enhance temporal features, respectively. Finally, we propose a multi-stream framework for integrating diverse skeletal modalities to achieve superior performance. Our AMD-GCN approach was extensively tested and proven to outperform the current state-of-the-art methods on three widely recognized benchmarks: the NTU-RGB+D, NTU-RGB+D 120, and Kinetics Skeleton datasets.
- 28 June 2023
- Published by MDPI AG in Electronics
- Vol. 12 (13) , 2852
Open AccessAdaptive Multi-Scale Difference Graph Convolution Network for Skeleton-Based Action Recognition
Graph convolutional networks (GCNs) have obtained remarkable performance in skeleton-based action recognition. However, previous approaches fail to capture the implicit correlations between joints and handle actions across varying time intervals. To address these problems, we propose an adaptive multi-scale difference graph convolution Network (AMD-GCN), which comprises an adaptive spatial graph convolution module (ASGC) and a multi-scale temporal difference convolution module (MTDC). The first module is capable of acquiring data-dependent and channel-wise graphs that are adaptable to both samples and channels. The second module employs the multi-scale approach to model temporal information across a range of time scales. Additionally, the MTDC incorporates an attention-enhanced module and difference convolution to accentuate significant channels and enhance temporal features, respectively. Finally, we propose a multi-stream framework for integrating diverse skeletal modalities to achieve superior performance. Our AMD-GCN approach was extensively tested and proven to outperform the current state-of-the-art methods on three widely recognized benchmarks: the NTU-RGB+D, NTU-RGB+D 120, and Kinetics Skeleton datasets.