Mobile Delivery Robots: Mixed Reality-Based Simulation Relying on ROS and Unity 3D
- 19 October 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 15-20
Abstract
In the context of Intelligent Transportation Systems and the delivery of goods, new technology approaches need to be developed in order to cope with certain challenges that last mile delivery entails, such as navigation in an urban environment. Autonomous delivery robots can help overcome these challenges. We propose a method for performing mixed reality (MR) simulation with ROS-based robots using Unity, which synchronizes the real and virtual environment, and simultaneously uses the sensor information of the real robots to locate themselves and project them into the virtual environment, so that they can use their virtual doppelganger to perceive the virtual world. Using this method, real and virtual robots can perceive each other and the environment in which the other party is located, thereby enabling the exchange of information between virtual and real objects. Through this approach a more realistic and reliable simulation can be obtained. Results of the demonstrated use-cases verified the feasibility and efficiency as well as the stability of implementing MR using Unity for Robot Operating System (ROS)-based robots.Keywords
All Related Versions
Funding Information
- Austrian Ministry for Climate Action, Environment, Energy, Mobility, Innovation and Technology (BMK)
This publication has 13 references indexed in Scilit:
- 3DCoAutoSim: Simulator for Cooperative ADAS and Automated Vehicles2018
- ROS and Unity Based Framework for Intelligent Vehicles Control and Simulation2018
- Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation of Operator Interfaces2018
- Implementation and Evaluation of a Traffic Light Assistance System Based on V2I Communication in a Simulation FrameworkJournal of Advanced Transportation, 2018
- ROSUnitySim: Development and experimentation of a real-time simulator for multi-unmanned aerial vehicle local planningSIMULATION, 2016
- Mixed reality for robotics2015
- From ROS to unity: Leveraging robot and virtual environment middleware for immersive teleoperation2014
- Robot design using Unity for computer games and robotic simulations2012
- An Experimental investigation of cooperative SLAMIFAC Proceedings Volumes, 2004
- VRPN2001