Object Detection and Navigation of a Mobile Robot by Fusing Laser and Camera Information
Authors:
- 28 June 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 557-563
Abstract
While state-of-the-art YOLO approaches have revolutionized real time object detection in mobile robotics, most of the publicly available models are trained on datasets with a small number of available classes. In addition, the difficulty in creating large datasets with many available classes for 2D object detection sets limitations to real world robotic applications and specialized use cases. This paper presents a solution that tackles these limitations by approaching object detection via fusion of 2D laser and RGB camera information resulting to a detector with 1000 learned classes. Object localization is performed in the 3D world by clustering the point cloud provided by the 2D laser scanner using the DBSCAN algorithm. The clusters are projected onto the image plane providing Regions of Interest (ROI), where proposed object bounding boxes are obtained, that are labeled with distance information. Object recognition is achieved using a pretrained, on the ImageNet dataset, ResNet and a voting schema among proposed bounding boxes, that also estimates the objects height. The detection system is used in combination with a navigation system that employs artificial potential field. The combination of the two, makes the robot’s perception easily adaptable to specialized applications and the robot’s behaviour adjustable to the complexity and variability of unstructured and unknown workspaces. The method has been implemented in ROS and tested both in simulation as well as in real case scenarios using the mobile robot Pioneer 3-DX. The work is aimed at robots with limited hardware and sensor capabilities and tries to enable detection via fusion, despite the limitations.Keywords
This publication has 17 references indexed in Scilit:
- Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and ChallengesIEEE Transactions on Intelligent Transportation Systems, 2020
- VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection2018
- Development of Mobile Robot Target Recognition and Following Behaviour Using Deep Convolutional Neural Network and 2D Range DataIFAC-PapersOnLine, 2018
- When to use what data set for your self-driving car algorithm: An overview of publicly available driving datasets2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Microsoft COCO: Common Objects in Context2014
- Fast Pedestrian Detection with Laser and Image Data Fusion2011
- ImageNet: A large-scale hierarchical image database2009
- Real-time obstacle avoidance for manipulators and mobile robots2005
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000