Online Object Searching by a Humanoid Robot in an Unknown Environment
- 23 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 2862-2869
Abstract
This letter proposes a framework for an autonomous humanoid robot, aimed at searching for a target object in an unknown environment using 3D-simultaneous localization and mapping (SLAM). The robot determines, while walking , the next viewpoint from an environment map and aggregated object recognition results, and automatically finds and grasps the target object. Whereas most robot exploration studies require a static map, hints regarding object position, area size limitations, or offline viewpoint planning time for each observation, our system can globally find an occluded object in an unknown environment, based only on the 3D target model. The biggest novelty of this research is that this framework always runs its viewpoint planner in background and immediately updates the destination if the camera gets environment/object information. To follow that goal change quickly, the humanoid robot re-plans its footstep trajectory without stopping, using foot landing estimation based on 3D-SLAM's localization. Notably, our robot can predict an unobserved area, and actively reveal it while avoiding obstacles. We validated the efficacy of this method through real experiments with an “HRP2-KAI” in several environments, and achieved fully automated searching and grasping.Keywords
This publication has 24 references indexed in Scilit:
- YOLO9000: Better, Faster, Stronger2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Three-Dimensional Bipedal Walking Control Based on Divergent Component of MotionIEEE Transactions on Robotics, 2015
- 3D POINT CLOUD MODEL COLORIZATION BY DENSE REGISTRATION OF DIGITAL IMAGESThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2015
- A probabilistic framework for next best view estimation in a cluttered environmentJournal of Visual Communication and Image Representation, 2014
- Online object search with a humanoid robot2007
- A Visual Attention Framework for Search Behavior by a Humanoid Robot2006
- Vision-guided humanoid footstep planning for dynamic environments2006
- An experiment in integrated exploration2003
- A frontier-based approach for autonomous exploration2002