Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Authors:
Top Cited Papers
- 6 April 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (6) , 2944-2956
Abstract
We introduce a deep network architecture called DerainNet for removing rain streaks from an image. Based on the deep convolutional neural network (CNN), we directly learn the mapping relationship between rainy and clean image detail layers from data. Because we do not possess the ground truth corresponding to real-world rainy images, we synthesize images with rain for training. In contrast to other common strategies that increase depth or breadth of the network, we use image processing domain knowledge to modify the objective function and improve deraining with a modestly sized CNN. Specifically, we train our DerainNet on the detail (high-pass) layer rather than in the image domain. Though DerainNet is trained on synthetic data, we find that the learned network translates very effectively to real-world images for testing. Moreover, we augment the CNN framework with image enhancement to improve the visual results. Compared with the state-of-the-art single image de-raining methods, our method has improved rain removal and much faster computation time after network training.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61571382, 81671766, 61571005, 81671674, U1605252, 61671309, 81301278)
- Guangdong Natural Science Foundation (2015A030313007)
- Fundamental Research Funds for the Central Universities (20720160075, 20720150169)
- Natural Science Foundation of Fujian Province of China (2017J01126)
- CCF-Tencent research fund
- China Scholarship Council ([2016]3100)
This publication has 27 references indexed in Scilit:
- Image Super-Resolution Using Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- Utilizing Local Phase Information to Remove Rain from VideoInternational Journal of Computer Vision, 2014
- Visual Depth Guided Color Image Rain Streaks Removal Using Sparse CodingIEEE Transactions on Circuits and Systems for Video Technology, 2014
- Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of StreaksInternational Journal of Computer Vision, 2011
- Analysis of Rain and Snow in Frequency SpaceInternational Journal of Computer Vision, 2009
- Photorealistic rendering of rain streaksACM Transactions on Graphics, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- UCID: an uncompressed color image database2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998