Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization
Authors:
- 29 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7184-7190
Abstract
We propose a framework to enable multipurpose assistive mobile robots to autonomously wipe tables to clean spills and crumbs. This problem is challenging, as it requires planning wiping actions while reasoning over uncertain latent dynamics of crumbs and spills captured via high-dimensional visual observations. Simultaneously, we must guarantee constraints satisfaction to enable safe deployment in unstructured cluttered environments. To tackle this problem, we first propose a stochastic differential equation to model crumbs and spill dynamics and absorption with a robot wiper. Using this model, we train a vision-based policy for planning wiping actions in simulation using reinforcement learning (RL). To enable zero-shot sim-to-real deployment, we dovetail the RL policy with a whole-body trajectory optimization framework to compute base and arm joint trajectories that execute the desired wiping motions while guaranteeing constraints satisfaction. We extensively validate our approach in simulation and on hardware. Video of experiments: https://youtu.be/inORKP4F3EIKeywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Learning generalizable surface cleaning actions from demonstration2017
- Funnel libraries for real-time robust feedback motion planningThe International Journal of Robotics Research, 2017
- Deep visual foresight for planning robot motion2017
- The material point method for simulating continuum materials2016
- Adaptation and coaching of periodic motion primitives through physical and visual interactionRobotics and Autonomous Systems, 2016
- Motion planning with sequential convex optimization and convex collision checkingThe International Journal of Robotics Research, 2014
- Stochastic optimal control for nonlinear markov jump diffusion processes2012
- Lévy Processes and Stochastic Calculus2009
- Applied Stochastic Control of Jump Diffusions2007
- Applied Stochastic Processes and Control for Jump-Diffusions: Modeling, Analysis and Computation2007