Model-Predictive Control for Omnidirectional Mobile Robots in Logistic Environments Based on Object Detection Using CNNs
Open Access
Abstract
Object detection is an essential component of autonomous mobile robotic systems, enabling robots to understand and interact with the environment. Object detection and recognition have made significant progress using convolutional neural networks (CNNs). Widely used in autonomous mobile robot applications, CNNs can quickly identify complicated image patterns, such as objects in a logistic environment. Integration of environment perception algorithms and motion control algorithms is a topic subjected to significant research. On the one hand, this paper presents an object detector to better understand the robot environment and the newly acquired dataset. The model was optimized to run on the mobile platform already on the robot. On the other hand, the paper introduces a model-based predictive controller to guide an omnidirectional robot to a particular position in a logistic environment based on an object map obtained from a custom-trained CNN detector and LIDAR data. Object detection contributes to a safe, optimal, and efficient path for the omnidirectional mobile robot. In a practical scenario, we deploy a custom-trained and optimized CNN model to detect specific objects in the warehouse environment. Then we evaluate, through simulation, a predictive control approach based on the detected objects using CNNs. Results are obtained in object detection using a custom-trained CNN with an in-house acquired data set on a mobile platform and in the optimal control for the omnidirectional mobile robot.Keywords
Funding Information
- Romanian Government (27PFE/2021)
This publication has 34 references indexed in Scilit:
- Fast Contour-Tracing Algorithm Based on a Pixel-Following Method for Image SensorsSensors, 2016
- Mechanical Design and Control System of an Omni-directional Mobile Robot for Material ConveyingProcedia CIRP, 2016
- Adaptive optimal control via reinforcement learning for omni-directional wheeled robots2016
- Very deep convolutional neural network based image classification using small training sample size2015
- Timed-Elastic-Bands for time-optimal point-to-point nonlinear model predictive control2015
- Going deeper with convolutions2015
- Design and development of an autonomous omni-directional mobile robot with Mecanum wheels2014
- Nonlinear Model Predictive Control for Omnidirectional Robot Motion Planning and Tracking With Avoidance of Moving ObstaclesCanadian Journal of Electrical and Computer Engineering, 2014
- Minimum-Energy Trajectory Generation for Cornering with a Fixed Heading for Three-Wheeled Omni-Directional Mobile RobotsJournal of Intelligent & Robotic Systems, 2013
- A Nonlinear Model Predictive Control of an Omni-Directional Mobile Robot2007