You Yao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
You Yao has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Zhiyong Li
Hunan University
4 shared publications - Jiacheng Lin
College of Computer Science and Electronic Engineering, Hunan University, Changsha, China
3 shared publications - Kailun Yang
Hunan University, Changsha, China
3 shared publications - Hao Shi
Zhejiang University
2 shared publications - Siyu Li
Hunan University
2 shared publications - Song Wang
College of Computer Science, Zhejiang University, Hangzhou, China
2 shared publications
Latest Publications
- Open Access
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Intelligent Transportation Systems
- Vol. 7, 1492-1506
GenMapping: Unveiling the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Intelligent Transportation Systems
- Vol. 7, 1492-1506
Open AccessGenMapping: Unveiling the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction
- 10 July 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (12) , 12066-12081
CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather
Visible-infrared image pairs provide complementary information, enhancing the reliability and robustness of object detection applications in real-world scenarios. However, most existing methods face challenges in maintaining robustness under complex weather conditions, which limits their applicability. Meanwhile, the reliance on attention mechanisms in modality fusion introduces significant computational complexity and storage overhead, particularly when dealing with high-resolution images. To address these challenges, we propose the Cross-modality Fusion Mamba with Weather-removal (CFMW) to augment stability and cost-effectiveness under adverse weather conditions. Leveraging the proposed Perturbation-Adaptive Diffusion Model (PADM) and Cross-modality Fusion Mamba (CFM) modules, CFMW is able to reconstruct visual features affected by adverse weather, enriching the representation of image details. With efficient architecture design, CFMW is 3 times faster than Transformer-style fusion (e.g., CFT). To bridge the gap in relevant datasets, we construct a new Severe Weather Visible-Infrared (SWVI) dataset, encompassing diverse adverse weather scenarios such as rain, haze, and snow. The dataset contains 64, 281 paired visible-infrared images, providing a valuable resource for future research. Extensive experiments on public datasets (i.e., M3FD and LLVIP) and the newly constructed SWVI dataset conclusively demonstrate that CFMW achieves state-of-the-art detection performance. Both the dataset and source code will be made publicly available at https://github.com/lhy-zjut/CFMW.
- 10 July 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (12) , 12066-12081
CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather
Visible-infrared image pairs provide complementary information, enhancing the reliability and robustness of object detection applications in real-world scenarios. However, most existing methods face challenges in maintaining robustness under complex weather conditions, which limits their applicability. Meanwhile, the reliance on attention mechanisms in modality fusion introduces significant computational complexity and storage overhead, particularly when dealing with high-resolution images. To address these challenges, we propose the Cross-modality Fusion Mamba with Weather-removal (CFMW) to augment stability and cost-effectiveness under adverse weather conditions. Leveraging the proposed Perturbation-Adaptive Diffusion Model (PADM) and Cross-modality Fusion Mamba (CFM) modules, CFMW is able to reconstruct visual features affected by adverse weather, enriching the representation of image details. With efficient architecture design, CFMW is 3 times faster than Transformer-style fusion (e.g., CFT). To bridge the gap in relevant datasets, we construct a new Severe Weather Visible-Infrared (SWVI) dataset, encompassing diverse adverse weather scenarios such as rain, haze, and snow. The dataset contains 64, 281 paired visible-infrared images, providing a valuable resource for future research. Extensive experiments on public datasets (i.e., M3FD and LLVIP) and the newly constructed SWVI dataset conclusively demonstrate that CFMW achieves state-of-the-art detection performance. Both the dataset and source code will be made publicly available at https://github.com/lhy-zjut/CFMW.
- Open Access
- 9 June 2025
- Published by MDPI AG in Preprints.org
A Knowledge-Enhanced Multi-Task Learning Model for Domain-Specific Question Answering
This paper presents GLM-6B-QA, a question-answering system designed to improve the performance of tasks in specialized domains. GLM-6B-QA uses the ChatGLM-6B model and integrates dynamic document attention (DDAM), query refinement layer (QRL), and knowledge injection layer (KIL) within a multi-task learning (MTL) framework. This setup enhances the model's ability to understand and process complex documents, queries, and terminology. By adjusting attention dynamically, refining query representations, and incorporating external knowledge, the system improves question answering, document comprehension, and term extraction. This method addresses challenges in natural language processing tasks and provides a better approach for developing adaptable systems in specialized applications.
- 9 June 2025
- Published by MDPI AG in Preprints.org
Open AccessA Knowledge-Enhanced Multi-Task Learning Model for Domain-Specific Question Answering
This paper presents GLM-6B-QA, a question-answering system designed to improve the performance of tasks in specialized domains. GLM-6B-QA uses the ChatGLM-6B model and integrates dynamic document attention (DDAM), query refinement layer (QRL), and knowledge injection layer (KIL) within a multi-task learning (MTL) framework. This setup enhances the model's ability to understand and process complex documents, queries, and terminology. By adjusting attention dynamically, refining query representations, and incorporating external knowledge, the system improves question answering, document comprehension, and term extraction. This method addresses challenges in natural language processing tasks and provides a better approach for developing adaptable systems in specialized applications.
- 2 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-13
Multigranularity Localization Transformer With Collaborative Understanding for Referring Multiobject Tracking
As an essential component of Vision-Based Measurement (VBM), Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video frames using linguistic prompts as references. To enhance the effectiveness of linguistic prompts when training, we introduce a novel Multi-Granularity Localization Transformer with collaborative understanding, termed MGLT. Unlike previous methods focused on visual-language fusion and post-processing, MGLT reevaluates RMOT by preventing linguistic clues from attenuating during propagation. MGLT comprises two key components: Multi-Granularity Implicit Query Bootstrapping (MGIQB) and Multi-Granularity Track-Prompt Alignment (MGTPA). MGIQB ensures that tracking and linguistic features are preserved in later layers of network propagation by bootstrapping the model to generate text-relevant and temporal-enhanced track queries. Simultaneously, MGTPA with multi-granularity linguistic prompts enhances the model’s localization ability by understanding the relative positions of different referred objects within a frame. Extensive experiments on well-recognized benchmarks demonstrate that MGLT achieves state-of-the-art performance. Notably, it shows significant improvements on Refer-KITTI dataset of 2.73%, 7.95%, and 3.18% in HOTA, AssA, and IDF1, respectively. The code will be available at https://github.com/JiajunChern/MGLT.
- 2 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-13
Multigranularity Localization Transformer With Collaborative Understanding for Referring Multiobject Tracking
As an essential component of Vision-Based Measurement (VBM), Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video frames using linguistic prompts as references. To enhance the effectiveness of linguistic prompts when training, we introduce a novel Multi-Granularity Localization Transformer with collaborative understanding, termed MGLT. Unlike previous methods focused on visual-language fusion and post-processing, MGLT reevaluates RMOT by preventing linguistic clues from attenuating during propagation. MGLT comprises two key components: Multi-Granularity Implicit Query Bootstrapping (MGIQB) and Multi-Granularity Track-Prompt Alignment (MGTPA). MGIQB ensures that tracking and linguistic features are preserved in later layers of network propagation by bootstrapping the model to generate text-relevant and temporal-enhanced track queries. Simultaneously, MGTPA with multi-granularity linguistic prompts enhances the model’s localization ability by understanding the relative positions of different referred objects within a frame. Extensive experiments on well-recognized benchmarks demonstrate that MGLT achieves state-of-the-art performance. Notably, it shows significant improvements on Refer-KITTI dataset of 2.73%, 7.95%, and 3.18% in HOTA, AssA, and IDF1, respectively. The code will be available at https://github.com/JiajunChern/MGLT.
- Open Access
- 15 November 2024
- Published by MDPI AG in Preprints.org
Enhancing Autonomous Vehicle Perception: A 6-DOF Pose Estimation Framework Using Deep Learning
This research addresses the critical challenge of precise perception of surrounding vehicles' positions and orientations in autonomous driving environments. We aim to develop an algorithm to estimate the absolute 6-degree-of-freedom (6-DOF) pose of vehicles from single images using a dataset of over 60,000 labeled 3D vehicle instances. Our approach integrates Faster R-CNN for 2D bounding box detection, Q-Net for 6D-pose regression, and DenseNet for enhanced feature extraction. Data analysis revealed attribution errors in pitch and yaw and significant variance in spatial accuracy across different vehicle models. By fine-tuning the Faster R-CNN on BDD100k and our dataset, and employing weighted bounding box and point fusion techniques, our model outperforms existing methods in accuracy and robustness. This work provides a reliable method for autonomous vehicles to perceive their surroundings accurately, enhancing navigation safety and efficiency.
- 15 November 2024
- Published by MDPI AG in Preprints.org
Open AccessEnhancing Autonomous Vehicle Perception: A 6-DOF Pose Estimation Framework Using Deep Learning
This research addresses the critical challenge of precise perception of surrounding vehicles' positions and orientations in autonomous driving environments. We aim to develop an algorithm to estimate the absolute 6-degree-of-freedom (6-DOF) pose of vehicles from single images using a dataset of over 60,000 labeled 3D vehicle instances. Our approach integrates Faster R-CNN for 2D bounding box detection, Q-Net for 6D-pose regression, and DenseNet for enhanced feature extraction. Data analysis revealed attribution errors in pitch and yaw and significant variance in spatial accuracy across different vehicle models. By fine-tuning the Faster R-CNN on BDD100k and our dataset, and employing weighted bounding box and point fusion techniques, our model outperforms existing methods in accuracy and robustness. This work provides a reliable method for autonomous vehicles to perceive their surroundings accurately, enhancing navigation safety and efficiency.
- 6 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (12) , 21672-21686
DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction
Temporal information plays a pivotal role in Bird’s-Eye-View (BEV) driving scene understanding, which can alleviate the visual information sparsity. However, the indiscriminate temporal fusion method will cause the barrier of feature redundancy when constructing vectorized High-Definition (HD) maps. In this paper, we revisit the temporal fusion of vectorized HD maps, focusing on temporal instance consistency and temporal map consistency learning. To improve the representation of instances in single-frame maps, we introduce a novel method, DTCLMapper. This approach uses a dual-stream temporal consistency learning module that combines instance embedding with geometry maps. In the instance embedding component, our approach integrates temporal Instance Consistency Learning (ICL), ensuring consistency from vector points and instance features aggregated from points. A vectorized points pre-selection module is employed to enhance the regression efficiency of vector points from each instance. Then aggregated instance features obtained from the vectorized points preselection module are grounded in contrastive learning to realize temporal consistency, where positive and negative samples are selected based on position and semantic information. The geometry mapping component introduces Map Consistency Learning (MCL) designed with self-supervised learning. The MCL enhances the generalization capability of our consistent learning approach by concentrating on the global location and distribution constraints of the instances. Extensive experiments on well-recognized benchmarks indicate that the proposed DTCLMapper achieves state-of-the-art performance in vectorized mapping tasks, reaching $61.9\%$ and $65.1\%$ mAP scores on the nuScenes and Argoverse datasets, respectively. The source code is available at https://github.com/lynn-yu/DTCLMapper.
- 6 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (12) , 21672-21686
DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction
Temporal information plays a pivotal role in Bird’s-Eye-View (BEV) driving scene understanding, which can alleviate the visual information sparsity. However, the indiscriminate temporal fusion method will cause the barrier of feature redundancy when constructing vectorized High-Definition (HD) maps. In this paper, we revisit the temporal fusion of vectorized HD maps, focusing on temporal instance consistency and temporal map consistency learning. To improve the representation of instances in single-frame maps, we introduce a novel method, DTCLMapper. This approach uses a dual-stream temporal consistency learning module that combines instance embedding with geometry maps. In the instance embedding component, our approach integrates temporal Instance Consistency Learning (ICL), ensuring consistency from vector points and instance features aggregated from points. A vectorized points pre-selection module is employed to enhance the regression efficiency of vector points from each instance. Then aggregated instance features obtained from the vectorized points preselection module are grounded in contrastive learning to realize temporal consistency, where positive and negative samples are selected based on position and semantic information. The geometry mapping component introduces Map Consistency Learning (MCL) designed with self-supervised learning. The MCL enhances the generalization capability of our consistent learning approach by concentrating on the global location and distribution constraints of the instances. Extensive experiments on well-recognized benchmarks indicate that the proposed DTCLMapper achieves state-of-the-art performance in vectorized mapping tasks, reaching $61.9\%$ and $65.1\%$ mAP scores on the nuScenes and Argoverse datasets, respectively. The source code is available at https://github.com/lynn-yu/DTCLMapper.
- 14 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (3) , 2080-2093
CDC-YOLOFusion: Leveraging Cross-Scale Dynamic Convolution Fusion for Visible-Infrared Object Detection
Feature-level fusion methods have demonstrated superior performance for visible- infrared object detection due to the deep exploration of visible and infrared features. However, most existing feature-level fusion methods utilize multiple convolutional layers with fixed parameters to extract bimodal features, leading to low adaptivity to diverse data distributions. This paper proposes a Cross-scale Dynamic Convolution-driven YOLO Fusion (CDC-YOLOFusion) network, which introduces a novel Cross-scale Dynamic Convolution Fusion (CDCF) module to adaptively extract and fuse bimodal features concerning on data distribution. Technically, CDC-YOLOFusion first designs a novel data augmentation strategy “Cross-modal Data Swapping” (CDS) to exchange local regions between visible and infrared images, effectively capturing cross-modal correlations within local regions. Building on this, the proposed CDCF utilizes cross-scale enhanced features to assist dynamic convolution prediction by introducing a disparity attention mask, which emphasizes the extraction of disparate features between two modalities. Our CDCF is effectively guided by a novel cross-modal kernel interaction loss, aiming the learned kernels to simultaneously focus on common salient features and unique features of each modality for comprehensive feature generation. Extensive experiments on three representative detection datasets demonstrate that CDCF can be easily plugined into the existing pipelines, obtaining consistent performance improvements. Moreover, our approach yields SOTA performance with about 2% to 3% mAP improvements as compared to the state-of-the-art methods. The code has been published in https://github.com/Morph-3800/CDC_YOLOFusion .
- 14 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (3) , 2080-2093
CDC-YOLOFusion: Leveraging Cross-Scale Dynamic Convolution Fusion for Visible-Infrared Object Detection
Feature-level fusion methods have demonstrated superior performance for visible- infrared object detection due to the deep exploration of visible and infrared features. However, most existing feature-level fusion methods utilize multiple convolutional layers with fixed parameters to extract bimodal features, leading to low adaptivity to diverse data distributions. This paper proposes a Cross-scale Dynamic Convolution-driven YOLO Fusion (CDC-YOLOFusion) network, which introduces a novel Cross-scale Dynamic Convolution Fusion (CDCF) module to adaptively extract and fuse bimodal features concerning on data distribution. Technically, CDC-YOLOFusion first designs a novel data augmentation strategy “Cross-modal Data Swapping” (CDS) to exchange local regions between visible and infrared images, effectively capturing cross-modal correlations within local regions. Building on this, the proposed CDCF utilizes cross-scale enhanced features to assist dynamic convolution prediction by introducing a disparity attention mask, which emphasizes the extraction of disparate features between two modalities. Our CDCF is effectively guided by a novel cross-modal kernel interaction loss, aiming the learned kernels to simultaneously focus on common salient features and unique features of each modality for comprehensive feature generation. Extensive experiments on three representative detection datasets demonstrate that CDCF can be easily plugined into the existing pipelines, obtaining consistent performance improvements. Moreover, our approach yields SOTA performance with about 2% to 3% mAP improvements as compared to the state-of-the-art methods. The code has been published in https://github.com/Morph-3800/CDC_YOLOFusion .