Ning Yang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ning Yang has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Bian Daokuan
Shandong University
1 shared publication - Boai Sun
Zhejiang University-Westlake University Joint Training, Zhejiang University, Hangzhou 310027, China
1 shared publication - Dixia Fan
Westlake University
1 shared publication - Haifeng Zhang
School of Astronautics, Harbin Institute of Technology, Harbin 150001, China
1 shared publication - Jun Wang
Department of Physics, Southeast University, Nanjing 210096, China
1 shared publication - Weicheng Cui
School of Engineering, Westlake University, Hangzhou 310030, China
1 shared publication
Latest Publications
- Open Access
- 1 March 2024
- Published by AIP Publishing in Physics of Fluids
- Vol. 36 (3)
Enhancing efficiency and propulsion in bio-mimetic robotic fish through end-to-end deep reinforcement learning
Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial role of control policies in enhancing efficiency has often been overlooked. In this study, we optimize the motion of a bio-mimetic robotic fish using deep reinforcement learning (DRL) to maximize propulsion efficiency and minimize energy consumption. Our novel DRL approach incorporates extended pressure perception, a transformer model processing sequences of observations, and a policy transfer scheme. Notably, significantly improved training stability and speed within our approach allow for end-to-end training of the robotic fish. This enables agiler responses to hydrodynamic environments and possesses greater optimization potential compared to pre-defined motion pattern controls. Our experiments are conducted on a serially connected rigid robotic fish in a free stream with a Reynolds number of 6000 using computational fluid dynamics simulations. The DRL-trained policies yield impressive results, demonstrating both high efficiency and propulsion. The policies also showcase the agent's embodiment, skillfully utilizing its body structure and engaging with surrounding fluid dynamics, as revealed through flow analysis. This study provides valuable insights into the bio-mimetic underwater robots optimization through DRL training, capitalizing on their structural advantages, and ultimately contributing to more efficient underwater propulsion systems.
- 1 March 2024
- Published by AIP Publishing in Physics of Fluids
- Vol. 36 (3)
Open AccessEnhancing efficiency and propulsion in bio-mimetic robotic fish through end-to-end deep reinforcement learning
Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial role of control policies in enhancing efficiency has often been overlooked. In this study, we optimize the motion of a bio-mimetic robotic fish using deep reinforcement learning (DRL) to maximize propulsion efficiency and minimize energy consumption. Our novel DRL approach incorporates extended pressure perception, a transformer model processing sequences of observations, and a policy transfer scheme. Notably, significantly improved training stability and speed within our approach allow for end-to-end training of the robotic fish. This enables agiler responses to hydrodynamic environments and possesses greater optimization potential compared to pre-defined motion pattern controls. Our experiments are conducted on a serially connected rigid robotic fish in a free stream with a Reynolds number of 6000 using computational fluid dynamics simulations. The DRL-trained policies yield impressive results, demonstrating both high efficiency and propulsion. The policies also showcase the agent's embodiment, skillfully utilizing its body structure and engaging with surrounding fluid dynamics, as revealed through flow analysis. This study provides valuable insights into the bio-mimetic underwater robots optimization through DRL training, capitalizing on their structural advantages, and ultimately contributing to more efficient underwater propulsion systems.
- 24 January 2021
- Published by Springer Nature
- p. 595-607
A Load-Shedding Algorithm for Power System Based on Transfer Learning
- 24 January 2021
- Published by Springer Nature
- p. 595-607
A Load-Shedding Algorithm for Power System Based on Transfer Learning