Lianghua Huang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Lianghua Huang has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Kaiqi Huang
University of Chinese Academy of Sciences
4 shared publications - Xin Zhao
School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China
3 shared publications - Yu Liu
Alibaba, Hangzhou, China
3 shared publications - Biao Jiang
School of Intelligence Science and Technology, Peking University, Beijing, China
1 shared publication - Bo Ma
Beijing Institute of Technology
1 shared publication - Ceyuan Yang
Shanghai AI Laboratory
1 shared publication
Latest Publications
- Open Access
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Mutual Forcing: Dual-Mode Self-Evolution for Fast Autoregressive Audio-Video Character Generation
- 30 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessMutual Forcing: Dual-Mode Self-Evolution for Fast Autoregressive Audio-Video Character Generation
- Open Access
- 9 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 55-62
DiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Models
- 9 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 55-62
Open AccessDiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Models
- 17 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 23 (15209210) , 4232-4244
Capturing Relevant Context for Visual Tracking
Studies have shown that context information will promote the robustness of trackers. However, the trackers based on Convolutional Neural Networks (CNNs) only capture local features, hence limiting its performance. Capturing long-range dependencies is crucial for the extraction of much richer features in CNNs, and it has been remarkably successful in numerous computer vision tasks (e.g., object segmentation, pose estimation). In this work, we introduce long-range dependencies into tracking model to capture much richer features, and show the significant improvement in tracking performance. We propose a novel Relevant Context Block (RCB), which employs Graph Convolutional Networks to capture the relevant context. In particular, it selects the k biggest contributors as nodes for each query position (unit) that contain meaningful and discriminative context information, and then updates the nodes by aggregating the differences between query position and its contributors. We find that this operation can be easily incorporated into the existing networks, and can be easily trained using standard back-propagation algorithm in an end-to-end manner. We further develop two trackers, SiamFC and GlobalTrack, to verify the effectiveness of the proposed RCB. Extensive experiments on OTB, VOT, UAV123, LaSOT, TrackingNet, OxUvA, and VOT2018LT show the superiority of our method. For example, Our Siam-RCB outperforms the baseline, SiamFC, by a very large margin (up to 11.2% in success score and 7.8% in precision score) on OTB-100 benchmark.
- 17 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 23 (15209210) , 4232-4244
Capturing Relevant Context for Visual Tracking
Studies have shown that context information will promote the robustness of trackers. However, the trackers based on Convolutional Neural Networks (CNNs) only capture local features, hence limiting its performance. Capturing long-range dependencies is crucial for the extraction of much richer features in CNNs, and it has been remarkably successful in numerous computer vision tasks (e.g., object segmentation, pose estimation). In this work, we introduce long-range dependencies into tracking model to capture much richer features, and show the significant improvement in tracking performance. We propose a novel Relevant Context Block (RCB), which employs Graph Convolutional Networks to capture the relevant context. In particular, it selects the k biggest contributors as nodes for each query position (unit) that contain meaningful and discriminative context information, and then updates the nodes by aggregating the differences between query position and its contributors. We find that this operation can be easily incorporated into the existing networks, and can be easily trained using standard back-propagation algorithm in an end-to-end manner. We further develop two trackers, SiamFC and GlobalTrack, to verify the effectiveness of the proposed RCB. Extensive experiments on OTB, VOT, UAV123, LaSOT, TrackingNet, OxUvA, and VOT2018LT show the superiority of our method. For example, Our Siam-RCB outperforms the baseline, SiamFC, by a very large margin (up to 11.2% in success score and 7.8% in precision score) on OTB-100 benchmark.
- Open Access
GlobalTrack: A Simple and Strong Baseline for Long-term Tracking
A key capability of a long-term tracker is to search for targets in very large areas (typically the entire image) to handle possible target absences or tracking failures. However, currently there is a lack of such a strong baseline for global instance search. In this work, we aim to bridge this gap. Specifically, we propose GlobalTrack, a pure global instance search based tracker that makes no assumption on the temporal consistency of the target's positions and scales. GlobalTrack is developed based on two-stage object detectors, and it is able to perform full-image and multi-scale search of arbitrary instances with only a single query as the guide. We further propose a cross-query loss to improve the robustness of our approach against distractors. With no online learning, no punishment on position or scale changes, no scale smoothing and no trajectory refinement, our pure global instance search based tracker achieves comparable, sometimes much better performance on four large-scale tracking benchmarks (i.e., 52.1% AUC on LaSOT, 63.8% success rate on TLP, 60.3% MaxGM on OxUvA and 75.4% normalized precision on TrackingNet), compared to state-of-the-art approaches that typically require complex post-processing. More importantly, our tracker runs without cumulative errors, i.e., any type of temporary tracking failures will not affect its performance on future frames, making it ideal for long-term tracking. We hope this work will be a strong baseline for long-term tracking and will stimulate future works in this area. Code is available at https://github.com/huanglianghua/GlobalTrack.
Open AccessGlobalTrack: A Simple and Strong Baseline for Long-term Tracking
A key capability of a long-term tracker is to search for targets in very large areas (typically the entire image) to handle possible target absences or tracking failures. However, currently there is a lack of such a strong baseline for global instance search. In this work, we aim to bridge this gap. Specifically, we propose GlobalTrack, a pure global instance search based tracker that makes no assumption on the temporal consistency of the target's positions and scales. GlobalTrack is developed based on two-stage object detectors, and it is able to perform full-image and multi-scale search of arbitrary instances with only a single query as the guide. We further propose a cross-query loss to improve the robustness of our approach against distractors. With no online learning, no punishment on position or scale changes, no scale smoothing and no trajectory refinement, our pure global instance search based tracker achieves comparable, sometimes much better performance on four large-scale tracking benchmarks (i.e., 52.1% AUC on LaSOT, 63.8% success rate on TLP, 60.3% MaxGM on OxUvA and 75.4% normalized precision on TrackingNet), compared to state-of-the-art approaches that typically require complex post-processing. More importantly, our tracker runs without cumulative errors, i.e., any type of temporary tracking failures will not affect its performance on future frames, making it ideal for long-term tracking. We hope this work will be a strong baseline for long-term tracking and will stimulate future works in this area. Code is available at https://github.com/huanglianghua/GlobalTrack.
- Top Cited Papers
- 4 December 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 43 (5) , 1562-1577
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The features of GOT-10k and the contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population, which ensures a comprehensive and relatively unbiased coverage of diverse moving objects. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.
- 4 December 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 43 (5) , 1562-1577
Top Cited PapersGOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The features of GOT-10k and the contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population, which ensures a comprehensive and relatively unbiased coverage of diverse moving objects. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.
- Open Access
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes, enabling unified training and stable evaluation of deep trackers. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. The protocol avoids biased evaluation results towards familiar objects and it promotes generalization in tracker development. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The annotations of GOT-10k's test data are kept private to avoid tuning parameters on it. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.
Open AccessGOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes, enabling unified training and stable evaluation of deep trackers. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. The protocol avoids biased evaluation results towards familiar objects and it promotes generalization in tracker development. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The annotations of GOT-10k's test data are kept private to avoid tuning parameters on it. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.
- 21 December 2016
- Published by Springer Nature
- p. 56-64
Cascaded Tracking with Incrementally Learned Projections
- 21 December 2016
- Published by Springer Nature
- p. 56-64
Cascaded Tracking with Incrementally Learned Projections