Virtual Reality for Robots
Authors:
- Markku SuomalainenMSMarkku Suomalainen
- Alexandra Q. NillesANAlexandra Q. Nilles
- Steven M. LaValleSLSteven M. LaValle
Preprint
Abstract
This paper applies the principles of Virtual Reality (VR) to robots, rather than living organisms. A simulator, of either physical states or information states, renders outputs to custom displays that fool the robot's sensors. This enables a robot to experience a combination of real and virtual sensor inputs, combining the efficiency of simulation and the benefits of real world sensor inputs. Thus, the robot can be taken through targeted experiences that are more realistic than pure simulation, yet more feasible and controllable than pure real-world experiences. We define two distinctive methods for applying VR to robots, namely black box and white box; based on these methods we identify potential applications, such as testing and verification procedures that are better than simulation, the study of spoofing attacks and anti-spoofing techniques, and sample generation for machine learning. A general mathematical framework is presented, along with a simple experiment, detailed examples, and discussion of the implications.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- FlightGoggles: Photorealistic Sensor Simulation for Perception-driven Robotics using Photogrammetry and Virtual Reality2019
- VR-Goggles for Robots: Real-to-Sim Domain Adaptation for Visual ControlIEEE Robotics and Automation Letters, 2019
- One Pixel Attack for Fooling Deep Neural NetworksIEEE Transactions on Evolutionary Computation, 2019
- Functional Forms of Optimum Spoofing Attacks for Vector Parameter Estimation in Quantized Sensor NetworksIEEE Transactions on Signal Processing, 2016
- Robust multimodal face and fingerprint fusion in the presence of spoofing attacksPattern Recognition, 2016
- Spoofing and countermeasures for speaker verification: A surveySpeech Communication, 2015
- From presence to consciousness through virtual realityNature Reviews Neuroscience, 2005
- Motion tracking: no silver bullet, but a respectable arsenalIEEE Computer Graphics and Applications, 2002
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- Reset Sequences for Monotonic AutomataSIAM Journal on Computing, 1990