Abstract
Actively tracking an arbitrary space non-cooperative object relied on visual sensor remains a challenging problem. In this paper, we provide an open-source benchmark for space non-cooperative object visual tracking including simulated environment, evaluation toolkit, and a PBVS baseline algorithm, which can facilitate the research in this topic especially for those methods based on deep reinforcement learning. We also present an end-to-end active visual tracker based on deep Q-learning, named as DRLAVT, which learns approximately optimal policy merely took color or RGBD images as input. To the best of our knowledge, it is the first intelligent agent used for active visual tracking in aerospace domain. The experiment results show that our DRLAVT achieves excellent robustness and real-time performance compared with the PBVS baseline, benefitted from the design of complex neural network and efficient reward function. In addition, the multiple targets training adopted in this paper effectively guarantees the transferability of DRLAVT by forcing the agent to learn optimal control policy with respect to motion patterns of the target.
Funding Information
  • National Key R&D Program of China (2019YFB1312001)

This publication has 34 references indexed in Scilit: