Planning Collision-Free Robot Motions in a Human–Robot Shared Workspace via Mixed Reality and Sensor-Fusion Skeleton Tracking
Open Access
- 1 August 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (15) , 2407
Abstract
The paper describes a method for planning collision-free motions of an industrial manipulator that shares the workspace with human operators during a human–robot collaborative application with strict safety requirements. The proposed workflow exploits the advantages of mixed reality to insert real entities into a virtual scene, wherein the robot control command is computed and validated by simulating robot motions without risks for the human. The proposed motion planner relies on a sensor-fusion algorithm that improves the 3D perception of the humans inside the robot workspace. Such an algorithm merges the estimations of the pose of the human bones reconstructed by means of a pointcloud-based skeleton tracking algorithm with the orientation data acquired from wearable inertial measurement units (IMUs) supposed to be fixed to the human bones. The algorithm provides a final reconstruction of the position and of the orientation of the human bones that can be used to include the human in the virtual simulation of the robotic workcell. A dynamic motion-planning algorithm can be processed within such a mixed-reality environment, allowing the computation of a collision-free joint velocity command for the real robot.Keywords
This publication has 25 references indexed in Scilit:
- Pure cycles in two-machine dual-gripper robotic cellsRobotics and Computer-Integrated Manufacturing, 2017
- A low-cost high-fidelity ultrasound simulator with the inertial tracking of the probe poseControl Engineering Practice, 2017
- Mixed reality for robotics2015
- A Kalman Filter-Based Framework for Enhanced Sensor FusionIEEE Sensors Journal, 2015
- Notes on Feasibility and Optimality Conditions of Small-Scale Multifunction Robotic Cell Scheduling Problems With Pickup RestrictionsIEEE Transactions on Industrial Informatics, 2014
- Automatic generation and detection of highly reliable fiducial markers under occlusionPattern Recognition, 2014
- V-REP: A versatile and scalable robot simulation framework2013
- A projection-based sensor system for safe physical human-robot collaboration2013
- A novel Quaternion integration approach for describing the behaviour of non-spherical particlesActa Mechanica, 2013
- The Open Motion Planning LibraryIEEE Robotics & Automation Magazine, 2012