Reliable Robotic Task Execution in the Face of Anomalies
- 12 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (1) , 314-321
Abstract
Learned robot policies have consistently been shown to be versatile, but they typically have no built-in mechanism for handling the complexity of open environments, making them prone to execution failures; this implies that deploying policies without the ability to recognise and react to failures may lead to unreliable and unsafe robot behaviour. In this letter, we present a framework that couples a learned policy with a method to detect visual anomalies during policy deployment and to perform recovery behaviours when necessary, thereby aiming to prevent failures. Specifically, we train an anomaly detection model using data collected during nominal executions of a trained policy. This model is then integrated into the online policy execution process, so that deviations from the nominal execution can trigger a three-level sequential recovery process that consists of (i) pausing the execution temporarily, (ii) performing a local perturbation of the robot's state, and (iii) resetting the robot to a safe state by sampling from a learned execution success model. We verify our proposed method in two different scenarios: (i) a door handle reaching task with a Kinova Gen3 arm using a policy trained in simulation and transferred to the real robot, and (ii) an object placing task with a UFactory xArm 6 using a general-purpose policy model. Our results show that integrating policy execution with anomaly detection and recovery increases the execution success rate in environments with various anomalies, such as trajectory deviations and adversarial human interventions.Keywords
All Related Versions
Funding Information
- b-it foundation and in part by a starting research
- Bonn-Rhein-Sieg University of Applied Sciences
This publication has 33 references indexed in Scilit:
- Adaptive Compliant Robot Control with Failure Recovery for Object Press-Fitting2023
- A hybrid skill parameterisation model combining symbolic and subsymbolic elements for introspective robotsRobotics and Autonomous Systems, 2022
- Understanding Test-Time Augmentation2021
- Emerging Properties in Self-Supervised Vision Transformers2021
- PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization2021
- RL-CycleGAN: Reinforcement Learning Aware Simulation-to-Real2020
- Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection2019
- Early Failure Detection of Deep End-to-End Control Policy by Reinforcement Learning2019
- Deep Residual Learning for Image Recognition2016
- Human-level control through deep reinforcement learningNature, 2015