Intelligent Motion Video Guidance for Unmanned Air System Ground Target Surveillance
Authors:
- 1 January 2016
- journal article
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 13 (1) , 10-26
Abstract
Unmanned air systems with video capturing systems for surveillance and visual tracking of ground targets have worked relatively well when employing gimbaled cameras controlled by two or more operators: one to fly the vehicle, and one to orient the camera and visually track ground targets. However, autonomous operation to reduce operator workload and crew levels is more challenging when the camera is strapdown, or fixed to the airframe without a pan-and-tilt capability, rather than gimbaled, so that the vehicle must be steered to orient the camera field of view. Visual tracking becomes even more difficult when the target follows an unpredictable path. This paper investigates a machine learning algorithm for visual tracking of stationary and moving ground targets by unmanned air systems with nongimbaling, fixed pan-and-tilt cameras. The algorithm is based on learning, and the learning agent initially determines an offline control policy for vehicle orientation and flight path such that a target can be tracked in the image frame of the camera without the need for operator input. Performance of the control policy is demonstrated with simulation test case scenarios for stationary, linear, and random moving targets with changes in target speeds and trajectories. Monte Carlo results presented in the paper demonstrate that the learned policies are capable of tracking stationary and moving targets with path perturbations, provided the perturbations are small. The learned policies are robust to small changes in target trajectory; therefore, learning separate policies for every type of trajectory is not required. The approach is judged to have merit for autonomous visual tracking of both fixed and randomly moving ground targets.
Keywords
This publication has 8 references indexed in Scilit:
- Visual Tracking in Wind with Field of View ConstraintsInternational Journal of Micro Air Vehicles, 2011
- Low-altitude road following using strap-down cameras on miniature air vehiclesMechatronics, 2011
- Cooperative Vision Based Estimation and Tracking Using Multiple UAVs2007
- Unmanned Aerial Vehicle Path Following for Target Observation in WindJournal of Guidance, Control, and Dynamics, 2006
- UAV Path Following for Constant Line-of-Sight2003
- Recent Advances in Hierarchical Reinforcement LearningDiscrete Event Dynamic Systems, 2003
- Reinforcement Learning: A SurveyJournal of Artificial Intelligence Research, 1996
- Dyna, an integrated architecture for learning, planning, and reactingACM SIGART Bulletin, 1991