Active Learning based on Data Uncertainty and Model Sensitivity
- 1 October 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1547-1554
Abstract
Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task. Failing to detect missing information often leads to abrupt movements or to collisions with the environment. Active learning can quantify the uncertainty of performing the task and, in general, locate regions of missing information. We introduce a novel algorithm for active learning and demonstrate its utility for generating smooth trajectories. Our approach is based on deep generative models and metric learning in latent spaces. It relies on the Jacobian of the likelihood to detect non-smooth transitions in the latent space, i.e., transitions that lead to abrupt changes in the movement of the robot. When non-smooth transitions are detected, our algorithm asks for an additional demonstration from that specific region. The newly acquired knowledge modifies the data manifold and allows for learning a latent representation for generating smooth movements. We demonstrate the efficacy of our approach on generalising elementary skills, transitioning across different skills, and implicitly avoiding collisions with the environment. For our experiments, we use a simulated pendulum where we observe its motion from images and a 7-DoF anthropomorphic arm.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Adaptive Active Learning for Image Classification2013
- Active learning of inverse models with intrinsically motivated goal exploration in robotsRobotics and Autonomous Systems, 2013
- Combining active learning and reactive control for robot graspingRobotics and Autonomous Systems, 2010
- The Automation of ScienceScience, 2009
- An active learning approach for assessing robot grasp reliability2005
- Active learning for vision-based robot graspingMachine Learning, 1996
- A Sequential Algorithm for Training Text Classifiers1994
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990
- Queries and concept learningMachine Learning, 1988
- Monte Carlo sampling methods using Markov chains and their applicationsBiometrika, 1970