Aim My Robot: Precision Local Navigation to Any Object
Authors:
- Xiangyun MengXMXiangyun Meng
- Xuning YangXYXuning Yang
- Sanghun JungSJSanghun Jung
- Fabio RamosFRFabio Ramos
- Srid Sadhan JujjavarapuSJSrid Sadhan Jujjavarapu
- Sanjoy PaulSPSanjoy Paul
- Dieter FoxDFDieter Fox
Preprint
Abstract
Existing navigation systems mostly consider "success" when the robot reaches within 1m radius to a goal. This precision is insufficient for emerging applications where the robot needs to be positioned precisely relative to an object for downstream tasks, such as docking, inspection, and manipulation. To this end, we design and implement Aim-My-Robot (AMR), a local navigation system that enables a robot to reach any object in its vicinity at the desired relative pose, with centimeter-level precision. AMR achieves high precision and robustness by leveraging multi-modal perception, precise action prediction, and is trained on large-scale photorealistic data generated in simulation. AMR shows strong sim2real transfer and can adapt to different robot kinematics and unseen objects with little to no fine-tuning.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Learning Generalizable Feature Fields for Mobile Manipulation2025
- SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World2024
- SPIN: Simultaneous Perception, Interaction and Navigation2024
- FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects2024
- Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation2024
- NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration2024
- Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models2024
- ASC: Adaptive Skill Coordination for Robotic Mobile ManipulationIEEE Robotics and Automation Letters, 2023
- Masked Autoencoders Are Scalable Vision Learners2022
- A path following control of an unmanned autonomous forkliftInternational Journal of Control, Automation, and Systems, 2009