XYXiangyang Yang

Xiangyang Yang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Xiangyang Yang has a total of 17 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • TR-MoE: Temporal Reliability-Aware Mixture-of-Experts for Robust Tracking

    by Tianle Wang, Xiangyang Yang, Jihua Zhu, Binrui Liu, YanZhao Li, Shuiwang Li

  • Toward Real-Time UAV Tracking With Adaptive and Background-Aware Vision Transformers

    by Xiangyang Yang, Dan Zeng, Xucheng Wang, Hengzhou Ye, Xiaolan Xie, Qijun Zhao, Jihua Zhu, Shuiwang Li

    In Unmanned Aerial Vehicle (UAV) tracking, discriminative correlation filters (DCF) are popular for their speed, making them ideal for real-time use with limited resources. Recently, lightweight convolutional neural networks (CNNs) have offered a new approach. Through filter pruning, these CNNs maintain high accuracy and efficiency, making them a strong alternative, especially for greater precision. Despite these advancements, the potential of pure vision transformers (ViTs) in UAV tracking remains largely untapped, especially based on the paradigm of conditional computation. In this work, we introduce an adaptive and background-aware Vision Transformer (Aba-ViT) and leverage it to develop a real-time UAV tracking framework called Aba-ViTrack. The proposed Aba-ViT exploits an adaptive and background-aware token computation method to reduce inference time. This approach adaptively discards tokens based on learned halting probabilities, which a priori are higher for background tokens than target ones. To further improve efficiency, this paper proposes a novel classroom-style learning (CSL) approach, where robustness knowledge is transmitted vertically from teacher to students, and generalization capability is enhanced through horizontal mutual learning among students. This method is used to compress Aba-ViTrack, resulting in Aba-ViTrack++. The upgraded version achieves a better balance between accuracy and efficiency in real-time UAV tracking. This version achieves a better balance between accuracy and efficiency for real-time UAV tracking. Extensive experiments on six UAV tracking benchmarks demonstrate that the proposed method achieves state-of-the-art performance in UAV tracking. The code is available at https://github.com/xyyang317/Aba-ViTrack.


  • Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking

    by You Wu, Yongxin Li, Mengyuan Liu, Xucheng Wang, Xiangyang Yang, Hengzhou Ye, Dan Zeng, Qijun Zhao, Shuiwang Li

    Transformer-based models have improved visual tracking, but most still cannot run in real time on resource-limited devices, especially for unmanned aerial vehicle (UAV) tracking. To achieve a better balance between performance and efficiency, we propose AVTrack, an adaptive computation tracking framework that adaptively activates transformer blocks through an Activation Module (AM), which dynamically optimizes the ViT architecture by selectively engaging relevant components. To address extreme viewpoint variations, we propose to learn view-invariant representations via mutual information (MI) maximization. In addition, we propose AVTrack-MD, an enhanced tracker incorporating a novel MI maximization-based multi-teacher knowledge distillation framework. Leveraging multiple off-the-shelf AVTrack models as teachers, we maximize the MI between their aggregated softened features and the corresponding softened feature of the student model, improving the generalization and performance of the student, especially under noisy conditions. Extensive experiments show that AVTrack-MD achieves performance comparable to AVTrack’s performance while reducing model complexity and boosting average tracking speed by over 17%. Codes is available at https://github.com/wuyou3474/AVTrack.


  • Adaptively bypassing vision transformer blocks for efficient visual tracking

    by Xiangyang Yang, Dan Zeng, Xucheng Wang, You Wu, Hengzhou Ye, Qijun Zhao, Shuiwang Li


  • Open Access

    Real-Time UAV Tracking Through Disentangled Representation With Mutual Information Maximization

    by Hengzhou Ye, Xiangyang Yang, You Wu, Xucheng Wang, Yongxin Li, Shuiwang Li

    Efficient UAV tracking faces challenges due to limited onboard resources, short battery life, and payload constraints. discriminative correlation filters (DCF)-based trackers have traditionally been preferred for their efficiency. However, recent lightweight deep learning (DL) trackers, leveraging model compression, exhibit significant CPU efficiency and precision. Unfortunately, existing model compression approaches have struggled with maintaining tracking precision, especially at higher compression rates. This paper addresses this limitation with a novel approach, called disentangled representation learning with mutual information maximization (DR-MIM). DR-MIM has the potential to enhance the accuracy and efficiency of DL-based trackers, particularly in UAV tracking. The primary concept underpinning this approach is disentangled representation which bifurcates the feature space into two distinct categories: identity-related and identity-unrelated elements. This bifurcation serves as a critical component, powering the heightened level of precision and efficiency attained by DL-based trackers. The focus of our work is predominantly on the employment of exclusively identity-related features. As a result of this focus, there’s a noticeable escalation in the efficacy of the feature representation. To further enhance efficiency without compromising accuracy, we have quantified the network, which has been named DR-MIM (v2). Exhaustive experiments conducted across four aerial tracking benchmarks have demonstrated the superiority of the proposed method. A standout performance on VisDrone2018 showcases DR-MIM (v2)’s impressive GPU speed of 658 FPS, coupled with a maintained precision of 82.1%, underscoring the potential of our approach in real-world UAV tracking scenarios.

  • Learning Target-Aware Vision Transformers for Real-Time UAV Tracking

    by Shuiwang Li, Xiangyang Yang, Xucheng Wang, Dan Zeng, Hengzhou Ye, Qijun Zhao

    In recent years, the field of unmanned aerial vehicle (UAV) tracking has grown rapidly, finding numerous applications across various industries. While DCF-based trackers remain the most efficient and widely used in UAV tracking, recently lightweight CNN-based trackers using filter pruning have also demonstrated impressive efficiency and precision. However, the performance of these lightweight CNN-based trackers are still far from satisfactory. In the of generic visual tracking, emerging ViT-based trackers have shown great success by using cross-attention instead of correlation operation, enabling more effective capturing of relationships between the target and the search image. But to our knowledge, the UAV tracking community has not yet well explored the potential of vision transformers for more effective and efficient template-search coupling for UAV tracking. In this paper, we propose an efficient ViT-based tracking framework for real-time UAV tracking. Our framework integrates feature learning and template-search coupling into an efficient one-stream ViT to avoid an extra heavy relation modeling module. However, we observe that it tends to weaken the target information through transformer blocks due to the significantly more background tokens. To address this problem, we propose to maximize the mutual information between the template image and its feature representation produced by the ViT. The proposed method is dubbed TATrack. Additionally, to further enhance efficiency, we introduce a novel mutual information maximization-based knowledge distillation, which strikes a better trade-off between accuracy and efficiency. Exhaustive experiments on five benchmarks show that the proposed tracker achieves state-of-the-art performance in UAV tracking. Code is released at: https://github.com/xyyang317/TATrack.