ZGZiliang Gan

Ziliang Gan

*This is an algorithmically generated author record based on publicly available information.

Ziliang Gan has a total of 33 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    NEXUS-O: An Omni-Perceptive and -Interactive Model for Language, Audio, and Vision

    by Che Liu, Yingji Zhang, Dong Zhang, Weijie Zhang, Chenggong Gong, Yu Lu, Shilin Zhou, Ziliang Gan, Ziao Wang, Haipang Wu, et al.


  • Open Access

    MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning

    by Ziliang Gan, Dong Zhang, Haohan Li, Yang Wu, Xueyuan Lin, Ji Liu, Haipang Wu, Chaoyou Fu, Zenglin Xu, Rongjunchen Zhang, et al.


  • Open Access

    SkatingVerse: A large‐scale benchmark for comprehensive evaluation on human action understanding

    by Ziliang Gan, Lei Jin, Yi Cheng, Yu Cheng, Yinglei Teng, Zun Li, Yawen Li, Wenhan Yang, Zheng Zhu, Junliang Xing, et al.

    Human action understanding (HAU) is a broad topic that involves specific tasks, such as action localisation, recognition, and assessment. However, most popular HAU datasets are bound to one task based on particular actions. Combining different but relevant HAU tasks to establish a unified action understanding system is challenging due to the disparate actions across datasets. A large‐scale and comprehensive benchmark, namely SkatingVerse is constructed for action recognition, segmentation, proposal, and assessment. SkatingVerse focus on fine‐grained sport action, hence figure skating is chosen as the task object, which eliminates the biases of the object, scene, and space that exist in most previous datasets. In addition, skating actions have inherent complexity and similarity, which is an enormous challenge for current algorithms. A total of 1687 official figure skating competition videos was collected with a total of 184.4 h, exceeding four times over other datasets with a similar topic. SkatingVerse enables to formulate a unified task to output fine‐grained human action classification and assessment results from a raw figure skating competition video. In addition, SkatingVerse can facilitate the study of HAU foundation model due to its large scale and abundant categories. Moreover, image modality is incorporated for human pose estimation task into SkatingVerse . Extensive experimental results show that (1) SkatingVerse significantly helps the training and evaluation of HAU methods, (2) the performance of existing HAU methods has much room to improve, and SkatingVerse helps to reduce such gaps, and (3) unifying relevant tasks in HAU through a uniform dataset can facilitate more practical applications. SkatingVerse will be publicly available to facilitate further studies on relevant problems.


  • Open Access

    Adaptive Multi-Scale Difference Graph Convolution Network for Skeleton-Based Action Recognition

    by Xiaojuan Wang, Ziliang Gan, Lei Jin, Yabo Xiao, Mingshu He

    Graph convolutional networks (GCNs) have obtained remarkable performance in skeleton-based action recognition. However, previous approaches fail to capture the implicit correlations between joints and handle actions across varying time intervals. To address these problems, we propose an adaptive multi-scale difference graph convolution Network (AMD-GCN), which comprises an adaptive spatial graph convolution module (ASGC) and a multi-scale temporal difference convolution module (MTDC). The first module is capable of acquiring data-dependent and channel-wise graphs that are adaptable to both samples and channels. The second module employs the multi-scale approach to model temporal information across a range of time scales. Additionally, the MTDC incorporates an attention-enhanced module and difference convolution to accentuate significant channels and enhance temporal features, respectively. Finally, we propose a multi-stream framework for integrating diverse skeletal modalities to achieve superior performance. Our AMD-GCN approach was extensively tested and proven to outperform the current state-of-the-art methods on three widely recognized benchmarks: the NTU-RGB+D, NTU-RGB+D 120, and Kinetics Skeleton datasets.