Exploring Image Generation for UAV Change Detection
Authors:
- 31 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/CAA Journal of Automatica Sinica
- Vol. 9 (6) , 1061-1072
Abstract
Change detection (CD) is becoming indispensable for unmanned aerial vehicles (|UAVs), especially in the domain of water landing, rescue and search. However, even the most advanced models require large amounts of data for model training and testing. Therefore, sufficient labeled images with different imaging conditions are needed. Inspired by computer graphics, we present a cloning method to simulate inland-water scene and collect an auto-labeled simulated dataset. The simulated dataset consists of six challenges to test the effects of dynamic background, weather, and noise on change detection models. Then, we propose an image translation framework that translates simulated images to synthetic images. This framework uses shared parameters (encoder and generator) and 22 × 22 receptive fields (discriminator) to generate realistic synthetic images as model training sets. The experimental results indicate that: 1) different imaging challenges affect the performance of change detection models; 2) compared with simulated images, synthetic images can effectively improve the accuracy of supervised models.Keywords
Funding Information
- China Postdoctoral Science Foundation (2020TQ1057,2020M682823)
- National Natural Science Foundation of China (U20B2071,U1913602,91948204)
This publication has 43 references indexed in Scilit:
- SuBSENSE: A Universal Change Detection Method With Local Adaptive SensitivityIEEE Transactions on Image Processing, 2014
- A Novel Video Dataset for Change Detection BenchmarkingIEEE Transactions on Image Processing, 2014
- Footprint of uncertainty for type-2 fuzzy setsInformation Sciences, 2014
- Background Subtraction with DirichletProcess Mixture ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Adaptively Splitted GMM With Feedback Improvement for the Task of Background SubtractionIEEE Transactions on Information Forensics and Security, 2014
- Background subtraction: separating the modeling and the inferenceMachine Vision and Applications, 2013
- Comparative study of background subtraction algorithmsJournal of Electronic Imaging, 2010
- Statistical Modeling of Complex Backgrounds for Foreground Object DetectionIEEE Transactions on Image Processing, 2004
- Background and foreground modeling using nonparametric kernel density estimation for visual surveillanceProceedings of the IEEE, 2002
- Learning patterns of activity using real-time trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000