Junjie Zhang

Controlling turbulent dynamics remains a major challenge because their chaotic, multiscale nature strongly affects many fluid systems. Here, we present REACT, an autonomous reinforcement learning framework for real-time, state-dependent control of turbulent wake dynamics in a wind tunnel. Deployed on an Ahmed-body model equipped only with onboard sensors and servo-actuated surfaces, REACT learns from sparse wind-tunnel measurements, bypassing empirical turbulence models. The agent autonomously converges to a policy that reduces aerodynamic drag while delivering net energy savings. Without prior knowledge of flow physics, it discovers that dynamically suppressing spatiotemporally coherent wake structures maximizes energy efficiency, achieving two to four times greater performance than model-based baseline controllers. We contrast REACT’s dynamics-aware, state-dependent policy with quasi-steady, mean-flow-oriented policies learned by standard reinforcement learning baselines, which yield lower drag reduction and do not suppress coherent instabilities in this turbulent-wake regime. Finally, by training in a nondimensional state-reward space with amplitudes approximately invariant to Reynolds number, and conditioning on Reynolds number for temporal adaptation, REACT learns an offline policy that remains effective across Re = 86,400-518,400 without retraining. These results demonstrate autonomous closed-loop reinforcement learning control in a high-Reynolds-number wind-tunnel environment and suggest a path toward data-driven, state-dependent control of turbulent flows.

Mastering turbulence remains one of physics’ most intractable challenges, with its chaotic, multi-scale dynamics driving energy dissipation across transport and energy systems. Here we report REACT (Reinforcement Learning for Environmental Adaptation and Control of Turbulence), a fully autonomous reinforcement learning framework that achieves real-time, adaptive, closed-loop turbulence control in real-world environments. Deployed on a road vehicle model equipped solely with onboard sensors and servo-actuated surfaces, REACT learns directly from sparse experimental measurements in a wind tunnel environment, bypassing intractable direct numerical simulations and empirical turbulence models. The agent autonomously converges to a policy that reduces aerodynamic drag while achieving net energy savings. Without prior knowledge of flow physics, it discovers that dynamically suppressing spatio-temporally coherent flow structures in the vehicle wake maximizes energy efficiency, achieving two to four times greater performance than model-based baseline controllers. Through a physics-informed training that recasts data in terms of dimensionless physical groups and parametric input spaces, REACT synthesizes offline a single generalizable agent that transfers across speeds without retraining. These results move agentic learning beyond simulation to robust, interpretable real-world control of high‑Reynolds turbulence, opening a path to self‑optimizing physical systems in transport, energy and environmental flows.

Mastering turbulence remains one of physics' most intractable challenges, with its chaotic, multi-scale dynamics driving energy dissipation across transport and energy systems. Here we report REACT (Reinforcement Learning for Environmental Adaptation and Control of Turbulence), a fully autonomous reinforcement learning framework that achieves real-time, adaptive, closed-loop turbulence control in real-world environments. Deployed on a road vehicle model equipped solely with onboard sensors and servo-actuated surfaces, REACT learns directly from sparse experimental measurements in a wind tunnel environment, bypassing intractable direct numerical simulations and empirical turbulence models. The agent autonomously converges to a policy that reduces aerodynamic drag while achieving net energy savings. Without prior knowledge of flow physics, it discovers that dynamically suppressing spatio-temporally coherent flow structures in the vehicle wake maximizes energy efficiency, achieving two to four times greater performance than model-based baseline controllers. Through a physics-informed training that recasts data in terms of dimensionless physical groups and parametric input spaces, REACT synthesizes offline a single generalizable agent that transfers across speeds without retraining. These results move agentic learning beyond simulation to robust, interpretable real-world control of high-Reynolds turbulence, opening a path to self-optimizing physical systems in transport, energy and environmental flows.