Learning to swim efficiently in a nonuniform flow field
- 7 June 2023
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 107 (6) , 065102
Abstract
Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. They can then navigate in response to these signals. We analyze this navigation by combining deep reinforcement learning with direct numerical simulations to resolve the hydrodynamics. We study how local and nonlocal information can be used to train a swimmer to achieve particular swimming tasks in a nonuniform flow field, in particular, a zigzag shear flow. The swimming tasks are (1) learning how to swim in the vorticity direction, (2) learning how to swim in the shear-gradient direction, and (3) learning how to swim in the shear-flow direction. We find that access to laboratory frame information on the swimmer's instantaneous orientation is all that is required in order to reach the optimal policy for tasks (1) and (2). However, information on both the translational and rotational velocities seems to be required to accomplish task (3). Inspired by biological microorganisms, we also consider the case where the swimmers sense local information, i.e., surface hydrodynamic forces, together with a signal direction. This might correspond to gravity or, for microorganisms with light sensors, a light source. In this case, we show that the swimmer can reach a comparable level of performance to that of a swimmer with access to laboratory frame variables. We also analyze the role of different swimming modes, i.e., pusher, puller, and neutral.Keywords
All Related Versions
Funding Information
- Japan Society for the Promotion of Science (JP 20H00129, 20H05619, 20K03786)
- Kyoto University
- University of Tokyo (jh21001-MDH, jh220054)
This publication has 39 references indexed in Scilit:
- Bacteria can exploit a flagellar buckling instability to change directionNature Physics, 2013
- Hydrodynamic interactions of self-propelled swimmersSoft Matter, 2013
- Self-folding polymeric containers for encapsulation and delivery of drugsAdvanced Drug Delivery Reviews, 2012
- Short-time motion of Brownian particles in a shear flowPhysical Review E, 2009
- The green algal eyespot apparatus: a primordial visual system and more?Current Genetics, 2008
- Hydrodynamic signal perception in the copepod Acartia tonsaMarine Ecology Progress Series, 1999
- Learning to predict by the methods of temporal differencesMachine Learning, 1988
- Chemotaxis in Escherichia coli analysed by Three-dimensional TrackingNature, 1972
- A spherical envelope approach to ciliary propulsionJournal of Fluid Mechanics, 1971
- On the squirming motion of nearly spherical deformable bodies through liquids at very small reynolds numbersCommunications on Pure and Applied Mathematics, 1952