YYYou Yao

You Yao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


You Yao has a total of 22 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather

    by Haoyuan Li, Qi Hu, Binjia Zhou, You Yao, Jiacheng Lin, Kailun Yang, Peng Chen

    Visible-infrared image pairs provide complementary information, enhancing the reliability and robustness of object detection applications in real-world scenarios. However, most existing methods face challenges in maintaining robustness under complex weather conditions, which limits their applicability. Meanwhile, the reliance on attention mechanisms in modality fusion introduces significant computational complexity and storage overhead, particularly when dealing with high-resolution images. To address these challenges, we propose the Cross-modality Fusion Mamba with Weather-removal (CFMW) to augment stability and cost-effectiveness under adverse weather conditions. Leveraging the proposed Perturbation-Adaptive Diffusion Model (PADM) and Cross-modality Fusion Mamba (CFM) modules, CFMW is able to reconstruct visual features affected by adverse weather, enriching the representation of image details. With efficient architecture design, CFMW is 3 times faster than Transformer-style fusion (e.g., CFT). To bridge the gap in relevant datasets, we construct a new Severe Weather Visible-Infrared (SWVI) dataset, encompassing diverse adverse weather scenarios such as rain, haze, and snow. The dataset contains 64, 281 paired visible-infrared images, providing a valuable resource for future research. Extensive experiments on public datasets (i.e., M3FD and LLVIP) and the newly constructed SWVI dataset conclusively demonstrate that CFMW achieves state-of-the-art detection performance. Both the dataset and source code will be made publicly available at https://github.com/lhy-zjut/CFMW.


  • Open Access

    A Knowledge-Enhanced Multi-Task Learning Model for Domain-Specific Question Answering

    by Gaozhe Jiang, You Yao, Huailing Mu, Qinyan Shen, Shicheng Zhou

    This paper presents GLM-6B-QA, a question-answering system designed to improve the performance of tasks in specialized domains. GLM-6B-QA uses the ChatGLM-6B model and integrates dynamic document attention (DDAM), query refinement layer (QRL), and knowledge injection layer (KIL) within a multi-task learning (MTL) framework. This setup enhances the model's ability to understand and process complex documents, queries, and terminology. By adjusting attention dynamically, refining query representations, and incorporating external knowledge, the system improves question answering, document comprehension, and term extraction. This method addresses challenges in natural language processing tasks and provides a better approach for developing adaptable systems in specialized applications.

  • Multigranularity Localization Transformer With Collaborative Understanding for Referring Multiobject Tracking

    by Jiajun Chen, Jiacheng Lin, Guojin Zhong, You Yao, Zhiyong Li

    As an essential component of Vision-Based Measurement (VBM), Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video frames using linguistic prompts as references. To enhance the effectiveness of linguistic prompts when training, we introduce a novel Multi-Granularity Localization Transformer with collaborative understanding, termed MGLT. Unlike previous methods focused on visual-language fusion and post-processing, MGLT reevaluates RMOT by preventing linguistic clues from attenuating during propagation. MGLT comprises two key components: Multi-Granularity Implicit Query Bootstrapping (MGIQB) and Multi-Granularity Track-Prompt Alignment (MGTPA). MGIQB ensures that tracking and linguistic features are preserved in later layers of network propagation by bootstrapping the model to generate text-relevant and temporal-enhanced track queries. Simultaneously, MGTPA with multi-granularity linguistic prompts enhances the model’s localization ability by understanding the relative positions of different referred objects within a frame. Extensive experiments on well-recognized benchmarks demonstrate that MGLT achieves state-of-the-art performance. Notably, it shows significant improvements on Refer-KITTI dataset of 2.73%, 7.95%, and 3.18% in HOTA, AssA, and IDF1, respectively. The code will be available at https://github.com/JiajunChern/MGLT.


  • Open Access

    Enhancing Autonomous Vehicle Perception: A 6-DOF Pose Estimation Framework Using Deep Learning

    by Muyun Li, Yi Lu, You Yao

    This research addresses the critical challenge of precise perception of surrounding vehicles' positions and orientations in autonomous driving environments. We aim to develop an algorithm to estimate the absolute 6-degree-of-freedom (6-DOF) pose of vehicles from single images using a dataset of over 60,000 labeled 3D vehicle instances. Our approach integrates Faster R-CNN for 2D bounding box detection, Q-Net for 6D-pose regression, and DenseNet for enhanced feature extraction. Data analysis revealed attribution errors in pitch and yaw and significant variance in spatial accuracy across different vehicle models. By fine-tuning the Faster R-CNN on BDD100k and our dataset, and employing weighted bounding box and point fusion techniques, our model outperforms existing methods in accuracy and robustness. This work provides a reliable method for autonomous vehicles to perceive their surroundings accurately, enhancing navigation safety and efficiency.

  • DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction

    by Siyu Li, Jiacheng Lin, Hao Shi, Jiaming Zhang, Song Wang, You Yao, Zhiyong Li, Kailun Yang

    Temporal information plays a pivotal role in Bird’s-Eye-View (BEV) driving scene understanding, which can alleviate the visual information sparsity. However, the indiscriminate temporal fusion method will cause the barrier of feature redundancy when constructing vectorized High-Definition (HD) maps. In this paper, we revisit the temporal fusion of vectorized HD maps, focusing on temporal instance consistency and temporal map consistency learning. To improve the representation of instances in single-frame maps, we introduce a novel method, DTCLMapper. This approach uses a dual-stream temporal consistency learning module that combines instance embedding with geometry maps. In the instance embedding component, our approach integrates temporal Instance Consistency Learning (ICL), ensuring consistency from vector points and instance features aggregated from points. A vectorized points pre-selection module is employed to enhance the regression efficiency of vector points from each instance. Then aggregated instance features obtained from the vectorized points preselection module are grounded in contrastive learning to realize temporal consistency, where positive and negative samples are selected based on position and semantic information. The geometry mapping component introduces Map Consistency Learning (MCL) designed with self-supervised learning. The MCL enhances the generalization capability of our consistent learning approach by concentrating on the global location and distribution constraints of the instances. Extensive experiments on well-recognized benchmarks indicate that the proposed DTCLMapper achieves state-of-the-art performance in vectorized mapping tasks, reaching $61.9\%$ and $65.1\%$ mAP scores on the nuScenes and Argoverse datasets, respectively. The source code is available at https://github.com/lynn-yu/DTCLMapper.


  • CDC-YOLOFusion: Leveraging Cross-Scale Dynamic Convolution Fusion for Visible-Infrared Object Detection

    by Zian Wang, Xianghui Liao, Jin Yuan, You Yao, Zhiyong Li

    Feature-level fusion methods have demonstrated superior performance for visible- infrared object detection due to the deep exploration of visible and infrared features. However, most existing feature-level fusion methods utilize multiple convolutional layers with fixed parameters to extract bimodal features, leading to low adaptivity to diverse data distributions. This paper proposes a Cross-scale Dynamic Convolution-driven YOLO Fusion (CDC-YOLOFusion) network, which introduces a novel Cross-scale Dynamic Convolution Fusion (CDCF) module to adaptively extract and fuse bimodal features concerning on data distribution. Technically, CDC-YOLOFusion first designs a novel data augmentation strategy “Cross-modal Data Swapping” (CDS) to exchange local regions between visible and infrared images, effectively capturing cross-modal correlations within local regions. Building on this, the proposed CDCF utilizes cross-scale enhanced features to assist dynamic convolution prediction by introducing a disparity attention mask, which emphasizes the extraction of disparate features between two modalities. Our CDCF is effectively guided by a novel cross-modal kernel interaction loss, aiming the learned kernels to simultaneously focus on common salient features and unique features of each modality for comprehensive feature generation. Extensive experiments on three representative detection datasets demonstrate that CDCF can be easily plugined into the existing pipelines, obtaining consistent performance improvements. Moreover, our approach yields SOTA performance with about 2% to 3% mAP improvements as compared to the state-of-the-art methods. The code has been published in https://github.com/Morph-3800/CDC_YOLOFusion .