Yi Du
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yi Du has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Chen Wang
University at Buffalo
3 shared publications - Shaoshu Su
University at Buffalo
3 shared publications - Taimeng Fu
University at Buffalo
3 shared publications - Xiao Lin
University at Buffalo
2 shared publications - Zhipeng Zhao
University at Buffalo
2 shared publications - Zitong Zhan
University at Buffalo
2 shared publications
Latest Publications
- 7 November 2026
- Published by SAGE Publications in The International Journal of Robotics Research
AnyNav: Visual neuro-symbolic friction learning for off-road navigation
Off-road navigation is critical for a wide range of field robotics applications from planetary exploration to disaster response. However, it remains a longstanding challenge due to unstructured environments and the inherently complex terrain–vehicle interactions. Traditional physics-based methods struggle to accurately capture the nonlinear dynamics underlying these interactions, while purely data-driven approaches often overfit to specific motion patterns, vehicle geometries, or platforms, limiting their generalization in diverse, real-world scenarios. To address these limitations, we introduce AnyNav, a vision-based friction estimation and navigation framework grounded in neuro-symbolic principles. Our approach integrates neural networks for visual perception with symbolic physical models for reasoning about terrain-vehicle dynamics. To enable learning in a self-supervised manner for real-world settings, we adopt the imperative learning paradigm, where a bilevel optimization framework leverages physics-based optimization for training the friction network. This explicit incorporation of physical reasoning substantially improves generalization across terrains, vehicle types, and operating conditions. Leveraging the predicted friction coefficients, we further develop a physics-informed navigation system capable of generating physically feasible, time-efficient paths together with corresponding speed profiles. We demonstrate that AnyNav seamlessly transfers from simulation to real-world robotic platforms, exhibiting strong robustness across different four-wheeled vehicles and diverse off-road environments.
- 7 November 2026
- Published by SAGE Publications in The International Journal of Robotics Research
AnyNav: Visual neuro-symbolic friction learning for off-road navigation
Off-road navigation is critical for a wide range of field robotics applications from planetary exploration to disaster response. However, it remains a longstanding challenge due to unstructured environments and the inherently complex terrain–vehicle interactions. Traditional physics-based methods struggle to accurately capture the nonlinear dynamics underlying these interactions, while purely data-driven approaches often overfit to specific motion patterns, vehicle geometries, or platforms, limiting their generalization in diverse, real-world scenarios. To address these limitations, we introduce AnyNav, a vision-based friction estimation and navigation framework grounded in neuro-symbolic principles. Our approach integrates neural networks for visual perception with symbolic physical models for reasoning about terrain-vehicle dynamics. To enable learning in a self-supervised manner for real-world settings, we adopt the imperative learning paradigm, where a bilevel optimization framework leverages physics-based optimization for training the friction network. This explicit incorporation of physical reasoning substantially improves generalization across terrains, vehicle types, and operating conditions. Leveraging the predicted friction coefficients, we further develop a physics-informed navigation system capable of generating physically feasible, time-efficient paths together with corresponding speed profiles. We demonstrate that AnyNav seamlessly transfers from simulation to real-world robotic platforms, exhibiting strong robustness across different four-wheeled vehicles and diverse off-road environments.
- 10 September 2026
- Published by Springer Nature
- p. 297-316
Vision-Language Memory for Spatial Reasoning
- 5 August 2025
- Published by SAGE Publications in The International Journal of Robotics Research
Imperative learning: A self-supervised neuro-symbolic learning framework for robot autonomy
Data-driven methods such as reinforcement and imitation learning have achieved remarkable success in robot autonomy. However, their data-centric nature still hinders them from generalizing well to ever-changing environments. Moreover, labeling data for robotic tasks is often impractical and expensive. To overcome these challenges, we introduce a new self-supervised neuro-symbolic (NeSy) computational framework, imperative learning (IL), for robot autonomy, leveraging the generalization abilities of symbolic reasoning. The framework of IL consists of three primary components: a neural module, a reasoning engine, and a memory system. We formulate IL as a special bilevel optimization (BLO), which enables reciprocal learning over the three modules. This overcomes the label-intensive obstacles associated with data-driven approaches and takes advantage of symbolic reasoning concerning logical reasoning, physical principles, geometric analysis, etc. We discuss several optimization techniques for IL and verify their effectiveness in five distinct robot autonomy tasks including path planning, rule induction, optimal control, visual odometry, and multi-robot routing. Through various experiments, we show that IL can significantly enhance robot autonomy capabilities and we anticipate that it will catalyze further research across diverse domains.
- 5 August 2025
- Published by SAGE Publications in The International Journal of Robotics Research
Imperative learning: A self-supervised neuro-symbolic learning framework for robot autonomy
Data-driven methods such as reinforcement and imitation learning have achieved remarkable success in robot autonomy. However, their data-centric nature still hinders them from generalizing well to ever-changing environments. Moreover, labeling data for robotic tasks is often impractical and expensive. To overcome these challenges, we introduce a new self-supervised neuro-symbolic (NeSy) computational framework, imperative learning (IL), for robot autonomy, leveraging the generalization abilities of symbolic reasoning. The framework of IL consists of three primary components: a neural module, a reasoning engine, and a memory system. We formulate IL as a special bilevel optimization (BLO), which enables reciprocal learning over the three modules. This overcomes the label-intensive obstacles associated with data-driven approaches and takes advantage of symbolic reasoning concerning logical reasoning, physical principles, geometric analysis, etc. We discuss several optimization techniques for IL and verify their effectiveness in five distinct robot autonomy tasks including path planning, rule induction, optimal control, visual odometry, and multi-robot routing. Through various experiments, we show that IL can significantly enhance robot autonomy capabilities and we anticipate that it will catalyze further research across diverse domains.