GestureMoRo: an algorithm for autonomous mobile robot teleoperation based on gesture recognition
Authors:
Open Access
- 14 March 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-16
Abstract
Gestures are a common way people communicate. Gesture-based teleoperation control systems tend to be simple to operate and suitable for most people’s daily use. This paper employed a LeapMotion sensor to develop a mobile robot control system based on gesture recognition, which mainly established connections through a client/server structure. The principles of gesture recognition in the system were studied and the relevant self-investigated algorithms—GestureMoRo, for the association between gestures and mobile robots were designed. Moreover, in order to avoid the unstably fluctuated movement of the mobile robot caused by palm shaking, the Gaussian filter algorithm was used to smooth and denoise the collected gesture data, which effectively improved the robustness and stability of the mobile robot’s locomotion. Finally, the teleoperation control strategy of the gesture to the WATER2 mobile robot was realized, and the effectiveness and practicability of the designed system were verified through multiple experiments.Keywords
This publication has 43 references indexed in Scilit:
- Teleoperation methods and enhancement techniques for mobile robots: A comprehensive surveyRobotics and Autonomous Systems, 2022
- Design of Manipulator Control System Based on Leap Motion2021
- Robust forward\backward control of wheeled mobile robotsISA Transactions, 2021
- A Method for Underwater Human–Robot Interaction Based on Gestures Tracking with Fuzzy ControlInternational Journal of Fuzzy Systems, 2021
- Adaptive general pinned synchronization of a class of disturbed complex networksCommunications in Nonlinear Science and Numerical Simulation, 2019
- Adaptive sliding mode fault-tolerant control for type-2 fuzzy systems with distributed delaysInformation Sciences, 2019
- Practical tracking control of linear motor via fractional-order sliding modeAutomatica, 2018
- Fault-tolerant iterative learning control for mobile robots non-repetitive trajectory tracking with output constraintsAutomatica, 2018
- Robust adaptive hierarchical insensitive tracking control of a class of leader-follower agentsInformation Sciences, 2017
- Predesignated fault-tolerant formation tracking quality for networked uncertain nonholonomic mobile robots in the presence of multiple faultsAutomatica, 2017