Space Noncooperative Object Active Tracking With Deep Reinforcement Learning
- 3 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Aerospace and Electronic Systems
- Vol. 58 (6) , 4902-4916
Abstract
Actively tracking an arbitrary space non-cooperative object relied on visual sensor remains a challenging problem. In this paper, we provide an open-source benchmark for space non-cooperative object visual tracking including simulated environment, evaluation toolkit, and a PBVS baseline algorithm, which can facilitate the research in this topic especially for those methods based on deep reinforcement learning. We also present an end-to-end active visual tracker based on deep Q-learning, named as DRLAVT, which learns approximately optimal policy merely took color or RGBD images as input. To the best of our knowledge, it is the first intelligent agent used for active visual tracking in aerospace domain. The experiment results show that our DRLAVT achieves excellent robustness and real-time performance compared with the PBVS baseline, benefitted from the design of complex neural network and efficient reward function. In addition, the multiple targets training adopted in this paper effectively guarantees the transferability of DRLAVT by forcing the agent to learn optimal control policy with respect to motion patterns of the target.Keywords
Funding Information
- National Key R&D Program of China (2019YFB1312001)
This publication has 34 references indexed in Scilit:
- An improved real-time visual tracking method for space non-cooperative target2016
- Deep Residual Learning for Image Recognition2016
- Autonomous robotic capture of non-cooperative target by adaptive extended Kalman filter based visual servoActa Astronautica, 2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Learning contact-rich manipulation skills with guided policy search2015
- Human-level control through deep reinforcement learningNature, 2015
- Object Tracking BenchmarkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Flight Results of Vision-Based Navigation for Autonomous Spacecraft Inspection of Unknown ObjectsJournal of Spacecraft and Rockets, 2014
- High-Speed Tracking with Kernelized Correlation FiltersIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- A review of space robotics technologies for on-orbit servicingProgress in Aerospace Sciences, 2014