Enhance Visual Recognition Under Adverse Conditions via Deep Networks
- 1 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 28 (9) , 4401-4412
Abstract
Visual recognition under adverse conditions is a very important and challenging problem of high practical value, due to the ubiquitous existence of quality distortions during image acquisition, transmission, or storage. While deep neural networks have been extensively exploited in the techniques of low-quality image restoration and high-quality image recognition tasks respectively, few studies have been done on the important problem of recognition from very low-quality images. This paper proposes a deep learning based framework for improving the performance of image and video recognition models under adverse conditions, using robust adverse pre-training or its aggressive variant. The robust adverse pre-training algorithms leverage the power of pre-training and generalizes conventional unsupervised pre-training and data augmentation methods. We further develop a transfer learning approach to cope with real-world datasets of unknown adverse conditions. The proposed framework is comprehensively evaluated on a number of image and video recognition benchmarks, and obtains significant performance improvements under various single or mixed adverse conditions. Our visualization and analysis further add to the explainability of results.Keywords
All Related Versions
Funding Information
- U.S. Army (W911NF-15-1-0317)
This publication has 28 references indexed in Scilit:
- Robust Single Image Super-Resolution via Deep Networks With Sparse PriorIEEE Transactions on Image Processing, 2016
- Video Super-Resolution With Convolutional Neural NetworksIEEE Transactions on Computational Imaging, 2016
- DeepFont2015
- Going deeper with convolutions2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Deep Face Recognition2015
- Design and evaluation of photometric image quality measures for effective face recognitionIET Biometrics, 2014
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Face recognition in unconstrained videos with matched background similarity2011
- Image Super-Resolution Via Sparse RepresentationIEEE Transactions on Image Processing, 2010