Xianhui Meng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xianhui Meng has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
- Jun Liu
University of Science and Technology of China, Hefei, China
4 shared publications Haonan Jiang
Zhejiang University of Technology, Hangzhou, China
2 shared publicationsLi Zhang
University of Science and Technology of China
2 shared publications- Li Zhang
University of Science and Technology of China, Hefei, China
2 shared publications Cewu Lu
Shanghai Jiao Tong University China
1 shared publication- Cewu Lu
Shanghai Jiao Tong University
1 shared publication
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16918-16925
DSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Risks
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16918-16925
Open AccessDSBench: A Comprehensive Benchmark for Evaluating External and In-Cabin Risks
- Open Access
- 5 June 2026
- Published by MDPI AG in Preprints.org
The Evaluation Bottleneck of Vision-Language-Action Models: A Evaluation-Centric Survey
Vision-Language-Action (VLA) models are advancing faster than the field can evaluate them reliably. Researchers use different metrics and lab-specific protocols, making it hard to tell whether reported gains reflect genuine progress or favorable evaluation choices. We present the first comprehensive benchmark-centric survey of VLA evaluation, covering 582 papers from 2023 to May 2026. We argue that a benchmark number supports a progress claim only if four conditions hold: the benchmark discriminates among top models; metrics capture the claimed capability; the procedure permits cross-paper comparison; and the inference from benchmark to deployment is valid. Current practice fails at all four. Benchmark choice is concentrated and saturated, with leading models clustering near the ceiling of dominant simulation suites. Metric reporting is one-dimensional, dominated by task success rate while efficiency, safety, and trajectory consistency remain underreported. Real-world evaluation is fragmented, with no widely adopted standard and few trials per task. Simulation scores are widely treated as evidence of real-world capability, yet standard task-centric suites correlate only weakly with real-robot performance unless explicitly calibrated to the target physical setup. These failures reveal a fundamental evaluation bottleneck: VLA models are advancing faster than our ability to measure that advance.
- 5 June 2026
- Published by MDPI AG in Preprints.org
Open AccessThe Evaluation Bottleneck of Vision-Language-Action Models: A Evaluation-Centric Survey
Vision-Language-Action (VLA) models are advancing faster than the field can evaluate them reliably. Researchers use different metrics and lab-specific protocols, making it hard to tell whether reported gains reflect genuine progress or favorable evaluation choices. We present the first comprehensive benchmark-centric survey of VLA evaluation, covering 582 papers from 2023 to May 2026. We argue that a benchmark number supports a progress claim only if four conditions hold: the benchmark discriminates among top models; metrics capture the claimed capability; the procedure permits cross-paper comparison; and the inference from benchmark to deployment is valid. Current practice fails at all four. Benchmark choice is concentrated and saturated, with leading models clustering near the ceiling of dominant simulation suites. Metric reporting is one-dimensional, dominated by task success rate while efficiency, safety, and trajectory consistency remain underreported. Real-world evaluation is fragmented, with no widely adopted standard and few trials per task. Simulation scores are widely treated as evidence of real-world capability, yet standard task-centric suites correlate only weakly with real-robot performance unless explicitly calibrated to the target physical setup. These failures reveal a fundamental evaluation bottleneck: VLA models are advancing faster than our ability to measure that advance.
- 14 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (8) , 10030-10047
Probing Effective and Efficient Category-Level Articulated Object Pose Perception
Category-level articulated object pose perception-encompassing both static pose estimation and dynamic pose tracking-is critical for embodied AI systems interacting with complex environments. Due to the inherent complexity and diverse motion structures of articulated objects, existing methods often exhibit limitations in adequately modeling kinematic constraints, handling self-occlusions, and meeting optimization requirements. Building upon EfficientCAPER [1], this work introduces CAPER++, a unified framework addressing these limitations through three key innovations: first, a joint-centric hierarchical model decomposes objects into a root part and constrained parts linked by joints, explicitly embedding kinematic constraints for geometrically consistent pose recovery. Second, an SE(3) manifold formulation leverages Lie algebra in the tangent space for singularity-free rotation representation and stable optimization, replacing error-prone direct regression. Third, for tracking, a proxy canonicalization strategy reformulates pose updates as SE(3) increment predictions relative to keyframes, enhanced by a dynamic keyframe mechanism to suppress drift. Extensive experiments on synthetic (ArtImage, PM-Videos), semi-synthetic (ReArtMix, ReArt-Videos), and real-world (RobotArm, RobotArm-Videos) benchmarks demonstrate state-of-the-art accuracy and robustness. CAPER++ achieves real-time inference (50 FPS) without post-processing, significantly advancing category-level articulated perception for real-world applications. Codes and datasets are available at project website: https://sites.google.com/view/caperplusplus https://sites.google.com/view/caperplusplus.
- 14 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (8) , 10030-10047
Probing Effective and Efficient Category-Level Articulated Object Pose Perception
Category-level articulated object pose perception-encompassing both static pose estimation and dynamic pose tracking-is critical for embodied AI systems interacting with complex environments. Due to the inherent complexity and diverse motion structures of articulated objects, existing methods often exhibit limitations in adequately modeling kinematic constraints, handling self-occlusions, and meeting optimization requirements. Building upon EfficientCAPER [1], this work introduces CAPER++, a unified framework addressing these limitations through three key innovations: first, a joint-centric hierarchical model decomposes objects into a root part and constrained parts linked by joints, explicitly embedding kinematic constraints for geometrically consistent pose recovery. Second, an SE(3) manifold formulation leverages Lie algebra in the tangent space for singularity-free rotation representation and stable optimization, replacing error-prone direct regression. Third, for tracking, a proxy canonicalization strategy reformulates pose updates as SE(3) increment predictions relative to keyframes, enhanced by a dynamic keyframe mechanism to suppress drift. Extensive experiments on synthetic (ArtImage, PM-Videos), semi-synthetic (ReArtMix, ReArt-Videos), and real-world (RobotArm, RobotArm-Videos) benchmarks demonstrate state-of-the-art accuracy and robustness. CAPER++ achieves real-time inference (50 FPS) without post-processing, significantly advancing category-level articulated perception for real-world applications. Codes and datasets are available at project website: https://sites.google.com/view/caperplusplus https://sites.google.com/view/caperplusplus.
- Open Access
Is Your VLM for Autonomous Driving Safety-Ready? A Comprehensive Benchmark for Evaluating External and In-Cabin Risks
Vision-Language Models (VLMs) show great promise for autonomous driving, but their suitability for safety-critical scenarios is largely unexplored, raising safety concerns. This issue arises from the lack of comprehensive benchmarks that assess both external environmental risks and in-cabin driving behavior safety simultaneously. To bridge this critical gap, we introduce DSBench, the first comprehensive Driving Safety Benchmark designed to assess a VLM's awareness of various safety risks in a unified manner. DSBench encompasses two major categories: external environmental risks and in-cabin driving behavior safety, divided into 10 key categories and a total of 28 sub-categories. This comprehensive evaluation covers a wide range of scenarios, ensuring a thorough assessment of VLMs' performance in safety-critical contexts. Extensive evaluations across various mainstream open-source and closed-source VLMs reveal significant performance degradation under complex safety-critical situations, highlighting urgent safety concerns. To address this, we constructed a large dataset of 98K instances focused on in-cabin and external safety scenarios, showing that fine-tuning on this dataset significantly enhances the safety performance of existing VLMs and paves the way for advancing autonomous driving technology. The benchmark toolkit, code, and model checkpoints will be publicly accessible.
Open AccessIs Your VLM for Autonomous Driving Safety-Ready? A Comprehensive Benchmark for Evaluating External and In-Cabin Risks
Vision-Language Models (VLMs) show great promise for autonomous driving, but their suitability for safety-critical scenarios is largely unexplored, raising safety concerns. This issue arises from the lack of comprehensive benchmarks that assess both external environmental risks and in-cabin driving behavior safety simultaneously. To bridge this critical gap, we introduce DSBench, the first comprehensive Driving Safety Benchmark designed to assess a VLM's awareness of various safety risks in a unified manner. DSBench encompasses two major categories: external environmental risks and in-cabin driving behavior safety, divided into 10 key categories and a total of 28 sub-categories. This comprehensive evaluation covers a wide range of scenarios, ensuring a thorough assessment of VLMs' performance in safety-critical contexts. Extensive evaluations across various mainstream open-source and closed-source VLMs reveal significant performance degradation under complex safety-critical situations, highlighting urgent safety concerns. To address this, we constructed a large dataset of 98K instances focused on in-cabin and external safety scenarios, showing that fine-tuning on this dataset significantly enhances the safety performance of existing VLMs and paves the way for advancing autonomous driving technology. The benchmark toolkit, code, and model checkpoints will be publicly accessible.
- Open Access
Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds
Articulated objects are prevalent in daily life and robotic manipulation tasks. However, compared to rigid objects, pose tracking for articulated objects remains an underexplored problem due to their inherent kinematic constraints. To address these challenges, this work proposes a novel point-pair-based pose tracking framework, termed \textbf{PPF-Tracker}. The proposed framework first performs quasi-canonicalization of point clouds in the SE(3) Lie group space, and then models articulated objects using Point Pair Features (PPF) to predict pose voting parameters by leveraging the invariance properties of SE(3). Finally, semantic information of joint axes is incorporated to impose unified kinematic constraints across all parts of the articulated object. PPF-Tracker is systematically evaluated on both synthetic datasets and real-world scenarios, demonstrating strong generalization across diverse and challenging environments. Experimental results highlight the effectiveness and robustness of PPF-Tracker in multi-frame pose tracking of articulated objects. We believe this work can foster advances in robotics, embodied intelligence, and augmented reality. Codes are available at https://github.com/mengxh20/PPFTracker.
Open AccessExploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds
Articulated objects are prevalent in daily life and robotic manipulation tasks. However, compared to rigid objects, pose tracking for articulated objects remains an underexplored problem due to their inherent kinematic constraints. To address these challenges, this work proposes a novel point-pair-based pose tracking framework, termed \textbf{PPF-Tracker}. The proposed framework first performs quasi-canonicalization of point clouds in the SE(3) Lie group space, and then models articulated objects using Point Pair Features (PPF) to predict pose voting parameters by leveraging the invariance properties of SE(3). Finally, semantic information of joint axes is incorporated to impose unified kinematic constraints across all parts of the articulated object. PPF-Tracker is systematically evaluated on both synthetic datasets and real-world scenarios, demonstrating strong generalization across diverse and challenging environments. Experimental results highlight the effectiveness and robustness of PPF-Tracker in multi-frame pose tracking of articulated objects. We believe this work can foster advances in robotics, embodied intelligence, and augmented reality. Codes are available at https://github.com/mengxh20/PPFTracker.