World Model Robustness via Surprise Recognition
Preprint
Abstract
AI systems deployed in the real world must contend with distractions and out-of-distribution (OOD) noise that can destabilize their policies and lead to unsafe behavior. While robust training can reduce sensitivity to some forms of noise, it is infeasible to anticipate all possible OOD conditions. To mitigate this issue, we develop an algorithm that leverages a world model's inherent measure of surprise to reduce the impact of noise in world model--based reinforcement learning agents. We introduce both multi-representation and single-representation rejection sampling, enabling robustness to settings with multiple faulty sensors or a single faulty sensor. While the introduction of noise typically degrades agent performance, we show that our techniques preserve performance relative to baselines under varying types and levels of noise across multiple environments within self-driving simulation domains (CARLA and Safety Gymnasium). Furthermore, we demonstrate that our methods enhance the stability of two state-of-the-art world models with markedly different underlying architectures: Cosmos and DreamerV3. Together, these results highlight the robustness of our approach across world modeling domains. We release our code at https://github.com/Bluefin-Tuna/WISER .Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- A Comprehensive Survey on Data AugmentationIEEE Transactions on Knowledge and Data Engineering, 2025
- Mastering diverse control tasks through world modelsNature, 2025
- CarDreamer: Open-Source Learning Platform for World-Model-Based Autonomous DrivingIEEE Internet of Things Journal, 2024
- Recent advances in sensor fault diagnosis: A reviewSensors and Actuators A: Physical, 2020
- Deep Residual Learning for Image Recognition2016