Geomagnetic Navigation for AUV based on Deep Reinforcement Learning Algorithm
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2571-2575
Abstract
For the problem of geomagnetic navigation in the case of autonomous underwater vehicle (AUV) without a prior geomagnetic information, this paper proposes a geomagnetic navigation algorithm based on deep reinforcement learning. Using the correlation between the geomagnetic parameters and the navigation trajectory, the Deep Q Network is used for choosing the navigation direction by multiple geomagnetic components, and the relative position is estimated by the difference between the geomagnetic parameters of the current position and the target position. Under the influence of the above navigation model, the multiple geomagnetic component gradually approaches the target value with the movement of the aircraft, thereby achieving the navigation purpose. By comparing with the evolutionary algorithm (EA), it is proved that the DQN algorithm have better convergence ability.Keywords
This publication has 15 references indexed in Scilit:
- Human-level control through deep reinforcement learningNature, 2015
- Geomagnetic navigation of AUV without a priori magnetic map2014
- Feature Extraction and Geomagnetic MatchingJournal of Navigation, 2013
- Magnetic-field perceptionNature, 2010
- A strong magnetic anomaly affects pigeon navigationJournal of Experimental Biology, 2009
- Geomagnetic map used in sea-turtle navigationNature, 2004
- A review of long‐distance movements by marine turtles, and the possible role of ocean currentsOikos, 2003
- True navigation and magnetic maps in spiny lobstersNature, 2003
- Q-learningMachine Learning, 1992
- Magnetic Anomalies as a Reference for Ground-speed and Map-matching NavigationJournal of Navigation, 1982