Abstract
Object Exploration and Mapping (OEM) is a novel embodied AI task that requires an agent to autonomously explore unknown environments, simultaneously detect and localize multiple objects, and construct a semantic object-level map. To solve this challenge, we propose a two-stage framework. First, a deep reinforcement learning-based OEM framework (DRL-OEM) is proposed to leverage auxiliary perception tasks and memory-augmented policy learning to guide efficient exploration. Second, we extend the DRL-OEM to Meta-OEM, where a meta-reinforcement learning framework is employed to enhance adaptation to unseen environments with a novel key-behavior-aware prioritized sampling strategy by reusing high-reward transitions. Extensive experiments conducted on customized AI2Thor scenes across diverse layouts and object configurations demonstrate that Meta-OEM significantly outperforms strong baselines, including DRL-OEM, PEARL, and MQL, achieving up to 2× higher success rates and faster convergence during adaptation. Visual and quantitative results confirm its superior object discovery coverage, pose estimation accuracy, and generalization capability in open-world scenarios.
Funding Information
  • National Natural Science Foundation of China (62202137)
  • Zhejiang Provincial Natural Science Foundation of China (LMS25F020009)