Path-planning microswimmers can swim efficiently in turbulent flows
Preprint
Abstract
We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two (2D) and three dimensions (3D). We show that this scheme allows microswimmers to find non-trivial paths, which enable them to reach a target on average in less time than a na\"ive microswimmer, which tries, at any instant of time and at a given position in space, to swim in the direction of the target. We use pseudospectral direct numerical simulations (DNSs) of the 2D and 3D (incompressible) Navier-Stokes equations to obtain the turbulent flows. We then introduce passive microswimmers that try to swim along a given direction in these flows; the microswimmwers do not affect the flow, but they are advected by it. Two, non-dimensional, control parameters play important roles in our learning scheme: (a) the ratio $\tilde{V}_s$ of the microswimmer's bare velocity $V_s$ and the root-mean-square (rms) velocity $u_{rms}$ of the turbulent fluid; and (b) the product $\tilde{B}$ of the microswimmer-response time $B$ and the rms vorticity $\omega_{rms}$ of the fluid. We show that, in a substantial part of the $\tilde{V}_s-\tilde{B}$ plane, the average time required for the microswimmers to reach the target, by using our adversarial-learning scheme, eventually reduces below the average time taken by microswimmers that follow the na\"ive strategy.
Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Zermelo’s problem: Optimal point-to-point navigation in 2D turbulent flows using reinforcement learningChaos: An Interdisciplinary Journal of Nonlinear Science, 2019
- Efficient collective swimming by harnessing vortices through deep reinforcement learningProceedings of the National Academy of Sciences, 2018
- Finding efficient swimming strategies in a three-dimensional chaotic flow by reinforcement learningThe European Physical Journal E, 2017
- An overview of the statistical properties of two-dimensional turbulence in fluids with particles, conducting fluids, fluids with polymer additives, binary-fluid mixtures, and superfluidsPhysics of Fluids, 2017
- Optimal Path Planning in Time-Varying Flows Using Adaptive DiscretizationIEEE Robotics and Automation Letters, 2017
- Flow Navigation by Smart Microswimmers via Reinforcement LearningPhysical Review Letters, 2017
- Turbulence triggers vigorous swimming but hinders motion strategy in planktonic copepodsJournal of The Royal Society Interface, 2015
- Turbulence drives microscale patches of motile phytoplanktonNature Communications, 2013
- Statistical properties of turbulence: An overviewPramana, 2009
- Technical Note: Q-LearningMachine Learning, 1992