Autonomous real-time control of turbulent dynamics
Preprint
- 26 September 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
Mastering turbulence remains one of physics’ most intractable challenges, with its chaotic, multi-scale dynamics driving energy dissipation across transport and energy systems. Here we report REACT (Reinforcement Learning for Environmental Adaptation and Control of Turbulence), a fully autonomous reinforcement learning framework that achieves real-time, adaptive, closed-loop turbulence control in real-world environments. Deployed on a road vehicle model equipped solely with onboard sensors and servo-actuated surfaces, REACT learns directly from sparse experimental measurements in a wind tunnel environment, bypassing intractable direct numerical simulations and empirical turbulence models. The agent autonomously converges to a policy that reduces aerodynamic drag while achieving net energy savings. Without prior knowledge of flow physics, it discovers that dynamically suppressing spatio-temporally coherent flow structures in the vehicle wake maximizes energy efficiency, achieving two to four times greater performance than model-based baseline controllers. Through a physics-informed training that recasts data in terms of dimensionless physical groups and parametric input spaces, REACT synthesizes offline a single generalizable agent that transfers across speeds without retraining. These results move agentic learning beyond simulation to robust, interpretable real-world control of high‑Reynolds turbulence, opening a path to self‑optimizing physical systems in transport, energy and environmental flows.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Closed-loop supersonic flow control with a high-speed experimental deep reinforcement learning frameworkJournal of Fluid Mechanics, 2025
- Learn to flap: foil non-parametric path planning via deep reinforcement learningJournal of Fluid Mechanics, 2024
- Active flow control for bluff body drag reduction using reinforcement learning with partial measurementsJournal of Fluid Mechanics, 2024
- Reinforcement learning of control strategies for reducing skin friction drag in a fully developed turbulent channel flowJournal of Fluid Mechanics, 2023
- Delay-aware model-based reinforcement learning for continuous controlNeurocomputing, 2021
- Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow controlJournal of Fluid Mechanics, 2019
- Stochastic modelling and feedback control of bistability in a turbulent bluff body wakeJournal of Fluid Mechanics, 2016
- Low-dimensional dynamics of a turbulent axisymmetric wakeJournal of Fluid Mechanics, 2014
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- Coherent vortex structures in thewake of a sphere and a circular disk at rest and under forced vibrationsJournal of Fluids and Structures, 1990