Xiaoqing Ye
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xiaoqing Ye has a total of 104 co-authors. Here are the top co-authors by number of shared publications:
- Xiao Tan
Department of Computer Vision Technology (VIS), Baidu Inc., Beijing, China
9 shared publications - Jingdong Wang
Baidu, Beijing, China
6 shared publications - Xiang Bai
Huazhong University of Science and Technology, Wuhan, China
6 shared publications - Errui Ding
Baidu
5 shared publications - Liang Du
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
5 shared publications Xiaolin Zhang
Bionic Vision System Laboratory, State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
5 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 12271-12280
DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 12271-12280
Open AccessDriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 10306-10315
Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 10306-10315
Open AccessLatent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 1 August 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (8) , 10042-10049
Hammer: H ierarchical A ttention Generation M eets M ixture-of- E xpe r ts Evaluation for End-to-End Autonomous Driving
- 1 August 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (8) , 10042-10049
Hammer: H ierarchical A ttention Generation M eets M ixture-of- E xpe r ts Evaluation for End-to-End Autonomous Driving
- 12 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (2) , 1738-1745
TakeAD: Preference-Based Post-Optimization for End-to-End Autonomous Driving With Expert Takeover Data
Existing end-to-end autonomous driving methods typically rely on imitation learning (IL) but face a key challenge: the misalignment between open-loop training and closed-loop deployment. This misalignment often triggers driver-initiated takeovers and system disengagements during closed-loop execution. How to leverage those expert takeover data from disengagement scenarios and effectively expand the IL policy's capability presents a valuable yet unexplored challenge. In this letter, we propose TakeAD, a novel preference-based post-optimization framework that fine-tunes the pre-trained IL policy with this disengagement data to enhance the closed-loop driving performance. First, we design an efficient expert takeover data collection pipeline inspired by human takeover mechanisms in real-world autonomous driving systems. Then, this post-optimization framework integrates iterative Dataset Aggregation (DAgger) for imitation learning with Direct Preference Optimization (DPO) for preference alignment. The DAgger stage equips the policy with fundamental capabilities to handle disengagement states through direct imitation of expert interventions. Subsequently, the DPO stage refines the policy's behavior to better align with expert preferences in disengagement scenarios. Through multiple iterations, the policy progressively learns recovery strategies for disengagement states, thereby mitigating the open-loop gap. Experiments on the closed-loop Bench2Drive benchmark demonstrate our method's effectiveness compared with pure IL methods, with comprehensive ablations confirming the contribution of each component.
- 12 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (2) , 1738-1745
TakeAD: Preference-Based Post-Optimization for End-to-End Autonomous Driving With Expert Takeover Data
Existing end-to-end autonomous driving methods typically rely on imitation learning (IL) but face a key challenge: the misalignment between open-loop training and closed-loop deployment. This misalignment often triggers driver-initiated takeovers and system disengagements during closed-loop execution. How to leverage those expert takeover data from disengagement scenarios and effectively expand the IL policy's capability presents a valuable yet unexplored challenge. In this letter, we propose TakeAD, a novel preference-based post-optimization framework that fine-tunes the pre-trained IL policy with this disengagement data to enhance the closed-loop driving performance. First, we design an efficient expert takeover data collection pipeline inspired by human takeover mechanisms in real-world autonomous driving systems. Then, this post-optimization framework integrates iterative Dataset Aggregation (DAgger) for imitation learning with Direct Preference Optimization (DPO) for preference alignment. The DAgger stage equips the policy with fundamental capabilities to handle disengagement states through direct imitation of expert interventions. Subsequently, the DPO stage refines the policy's behavior to better align with expert preferences in disengagement scenarios. Through multiple iterations, the policy progressively learns recovery strategies for disengagement states, thereby mitigating the open-loop gap. Experiments on the closed-loop Bench2Drive benchmark demonstrate our method's effectiveness compared with pure IL methods, with comprehensive ablations confirming the contribution of each component.
- 14 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 27 (15209210) , 7230-7242
Coupling and Decoupling: Towards Temporal Feedback for 3D Object Detection
3D object detection has garnered significant attention within the academic community, primarily due to its broad utility in domains such as autonomous driving and robotics. Prior research efforts have predominantly concentrated on leveraging temporal contextual information embedded within sequential data to enhance the current feature representations. However, a notable limitation of these endeavors lies in their inadequate treatment of the inherent noise present within historical sequences, thereby constraining the efficiency of fusion methods. In this paper, we propose a new temporal feedback network, named TFNet, to model and correct the temporal noise by designing a coupling-decoupling mechanism. Central to our approach are two distinct modules: (i) Foreground Feature Enhancement, which amplifies sparse instance details across temporal frames, thereby furnishing essential local information priors for subsequent fusion; and (ii) Coupling-Decoupling Feature Interaction, designed to first aggregate temporal contextual information and then disentangle fusion features into frame-specific representations. Leveraging a feedback strategy, this module can adaptively enhance useful information and eliminate noise within individual frame features. Empirical evaluations conducted on the nuScenes benchmark demonstrate the effectiveness of TFNet, achieving the new state-of-the-art performance without any bells and whistles.
- 14 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 27 (15209210) , 7230-7242
Coupling and Decoupling: Towards Temporal Feedback for 3D Object Detection
3D object detection has garnered significant attention within the academic community, primarily due to its broad utility in domains such as autonomous driving and robotics. Prior research efforts have predominantly concentrated on leveraging temporal contextual information embedded within sequential data to enhance the current feature representations. However, a notable limitation of these endeavors lies in their inadequate treatment of the inherent noise present within historical sequences, thereby constraining the efficiency of fusion methods. In this paper, we propose a new temporal feedback network, named TFNet, to model and correct the temporal noise by designing a coupling-decoupling mechanism. Central to our approach are two distinct modules: (i) Foreground Feature Enhancement, which amplifies sparse instance details across temporal frames, thereby furnishing essential local information priors for subsequent fusion; and (ii) Coupling-Decoupling Feature Interaction, designed to first aggregate temporal contextual information and then disentangle fusion features into frame-specific representations. Leveraging a feedback strategy, this module can adaptively enhance useful information and eliminate noise within individual frame features. Empirical evaluations conducted on the nuScenes benchmark demonstrate the effectiveness of TFNet, achieving the new state-of-the-art performance without any bells and whistles.
- Open Access
- 27 June 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
CLIP-GS: CLIP-Informed Gaussian Splatting for View-Consistent 3D Indoor Semantic Understanding
Exploiting 3D Gaussian Splatting (3DGS) with Contrastive Language-Image Pre-Training (CLIP) models for open-vocabulary 3D semantic understanding of indoor scenes has emerged as an attractive research focus. Existing methods typically attach high-dimensional CLIP semantic embeddings to 3D Gaussians and leverage view-inconsistent 2D CLIP semantics as Gaussian supervision, resulting in efficiency bottlenecks and deficient 3D semantic consistency. To address these challenges, we present CLIP-GS, efficiently achieving a coherent semantic understanding of 3D indoor scenes via the proposed Semantic Attribute Compactness (SAC) and 3D Coherent Regularization (3DCR). SAC approach exploits the naturally unified semantics within objects to learn compact, yet effective, semantic Gaussian representations, enabling highly efficient rendering (>100 FPS). 3DCR enforces semantic consistency in 2D and 3D domains: In 2D, 3DCR utilizes refined view-consistent semantic outcomes derived from 3DGS to establish cross-view coherence constraints; in 3D, 3DCR encourages features similar among 3D Gaussian primitives associated with the same object, leading to more precise and coherent segmentation results. Extensive experimental results demonstrate that our method remarkably suppresses existing state-of-the-art approaches, achieving mIoU improvements of 21.20% and 13.05% on ScanNet and Replica datasets, respectively, while maintaining real-time rendering speed. Furthermore, our approach exhibits superior performance even with sparse input data, substantiating its robustness.
- 27 June 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
Open AccessCLIP-GS: CLIP-Informed Gaussian Splatting for View-Consistent 3D Indoor Semantic Understanding
Exploiting 3D Gaussian Splatting (3DGS) with Contrastive Language-Image Pre-Training (CLIP) models for open-vocabulary 3D semantic understanding of indoor scenes has emerged as an attractive research focus. Existing methods typically attach high-dimensional CLIP semantic embeddings to 3D Gaussians and leverage view-inconsistent 2D CLIP semantics as Gaussian supervision, resulting in efficiency bottlenecks and deficient 3D semantic consistency. To address these challenges, we present CLIP-GS, efficiently achieving a coherent semantic understanding of 3D indoor scenes via the proposed Semantic Attribute Compactness (SAC) and 3D Coherent Regularization (3DCR). SAC approach exploits the naturally unified semantics within objects to learn compact, yet effective, semantic Gaussian representations, enabling highly efficient rendering (>100 FPS). 3DCR enforces semantic consistency in 2D and 3D domains: In 2D, 3DCR utilizes refined view-consistent semantic outcomes derived from 3DGS to establish cross-view coherence constraints; in 3D, 3DCR encourages features similar among 3D Gaussian primitives associated with the same object, leading to more precise and coherent segmentation results. Extensive experimental results demonstrate that our method remarkably suppresses existing state-of-the-art approaches, achieving mIoU improvements of 21.20% and 13.05% on ScanNet and Replica datasets, respectively, while maintaining real-time rendering speed. Furthermore, our approach exhibits superior performance even with sparse input data, substantiating its robustness.
- 30 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (3) , 3071-3083
An Empirical Study of Ground Segmentation for 3-D Object Detection
The ratio of foreground and background points directly impacts the accuracy and speed of the lidar-based 3D object detection methods. However, existing methods generally ignore the impact of ground points. Although some traditional ground segmentation algorithms are available to remove ground point clouds, they usually suffer from over-segmentation, which leads to a sub-optimal and even worse performance for the downstream 3D detection task. We conduct an in-depth analysis and attribute this phenomenon to the reason that some crucial foreground points attached to the ground (e.g., the wheels of Cars, or the feet of Pedestrians) are directly removed due to over-segmentation. To this end, we propose a new Attached Point Restoring (APR) module to recover these discarded foreground points. Experimental results demonstrate the effectiveness and generalization of APR by integrating it into various ground segmentation algorithms to boost the performance or the running time of 3D detection on KITTI and Waymo datasets. Finally, we hope this paper can serve as a new guide to inspire future research in this field. Code is available at https://github.com/yhc2021/GPR.
- 30 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (3) , 3071-3083
An Empirical Study of Ground Segmentation for 3-D Object Detection
The ratio of foreground and background points directly impacts the accuracy and speed of the lidar-based 3D object detection methods. However, existing methods generally ignore the impact of ground points. Although some traditional ground segmentation algorithms are available to remove ground point clouds, they usually suffer from over-segmentation, which leads to a sub-optimal and even worse performance for the downstream 3D detection task. We conduct an in-depth analysis and attribute this phenomenon to the reason that some crucial foreground points attached to the ground (e.g., the wheels of Cars, or the feet of Pedestrians) are directly removed due to over-segmentation. To this end, we propose a new Attached Point Restoring (APR) module to recover these discarded foreground points. Experimental results demonstrate the effectiveness and generalization of APR by integrating it into various ground segmentation algorithms to boost the performance or the running time of 3D detection on KITTI and Waymo datasets. Finally, we hope this paper can serve as a new guide to inspire future research in this field. Code is available at https://github.com/yhc2021/GPR.
- 23 November 2024
- Published by Springer Nature
- p. 56-72
Make Your ViT-Based Multi-view 3D Detectors Faster via Token Compression
- 23 November 2024
- Published by Springer Nature
- p. 56-72
Make Your ViT-Based Multi-view 3D Detectors Faster via Token Compression
- 1 November 2024
- Published by Springer Nature
- p. 110-126
SEED: A Simple and Effective 3D DETR in Point Clouds
- 1 November 2024
- Published by Springer Nature
- p. 110-126
SEED: A Simple and Effective 3D DETR in Point Clouds
- 29 October 2024
- Published by Springer Nature
- p. 146-162
OPEN: Object-Wise Position Embedding for Multi-view 3D Object Detection
- 29 October 2024
- Published by Springer Nature
- p. 146-162
OPEN: Object-Wise Position Embedding for Multi-view 3D Object Detection