Abstract
Separate control of mobile manipulation offers a promising paradigm for managing its complexity by planning for these modalities independently. However, end-to-end learning of such behaviors necessitates effective mechanisms for both embodiment selection and motion planning. For low-level motion planning, prior world model-based reinforcement learning (RL) approaches have employed the similarity of latent states as a dense reward proxy. However, using latent similarity as an implicit distance metric yields inaccurate representations and depends heavily on predefined goal states. In this work, we address the limitations of similarity-based rewards by explicitly integrating 3D spatial information into the world model and deriving more accurate rewards from that distance-aware model for policy training. For high-level embodiment selection, prior model-based methods have either utilized reachability rewards inferred from predicted task rewards or relied on heuristic composite rewards. In this study, we retain the reachability reward and demonstrate that it yields superior performance in embodiment selection compared with composite reward formulations. By combining reachability-based selection and distance-guided planning, the model improves the performance of end-to-end learning for separate mobile manipulation behaviors. Extensive evaluations were conducted across two simulation environments with both fixed and randomized target settings. For motion planning, the distance reward achieves near 100% success rates across all configurations, significantly outperforming the baseline similarity reward, which achieves only 60% success in fixed-target scenarios and drops below 20% when targets are randomized. Regarding embodiment selection, the reachability-based separate control rapidly achieves a stable result with over 85% of arm activations occurring rationally within the near-goal region. Conversely, the heuristic composite reward slowly increases to a maximum of 60% for near-goal arm selections. These findings validate that the reachability reward provides a more effective and efficient mechanism for embodiment selection.
Funding Information
  • Japan Agency for Medical Research and Development (JPMJMS2011)