An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion
- 26 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 29 (10577149) , 8668-8679
Abstract
Capturing an all-in-focus image with a single camera is difficult since the depth of field of the camera is usually limited. An alternative method to obtain the all-in-focus image is to fuse several images that are focused at different depths. However, existing multi-focus image fusion methods cannot obtain clear results for areas near the focused/defocused boundary (FDB). In this paper, a novel α-matte boundary defocus model is proposed to generate realistic training data with the defocus spread effect precisely modeled, especially for areas near the FDB. Based on this α-matte defocus model and the generated data, a cascaded boundary-aware convolutional network termed MMF-Net is proposed and trained, aiming to achieve clearer fusion results around the FDB. Specifically, the MMF-Net consists of two cascaded subnets for initial fusion and boundary fusion. These two subnets are designed to first obtain a guidance map of FDB and then refine the fusion near the FDB. Experiments demonstrate that with the help of the new α-matte boundary defocus model, the proposed MMF-Net outperforms the state-of-the-art methods both qualitatively and quantitatively.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61771276)
- National Basic Research Program of China (2016YFB0101001)
This publication has 31 references indexed in Scilit:
- Multi-focus image fusion using dictionary-based sparse representationInformation Fusion, 2015
- Multi-focus image fusion with dense SIFTInformation Fusion, 2015
- Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decompositionOptics Communications, 2015
- A Comparative Study of Various Digital Image Fusion Techniques: A ReviewInternational Journal of Computer Applications, 2015
- Robust Match Fusion Using OptimizationIEEE Transactions on Cybernetics, 2014
- Defocus map estimation from a single imagePattern Recognition, 2011
- Multi-focus image fusion using PCNNPattern Recognition, 2010
- Guided Image Filtering2010
- Multifocus image fusion using the nonsubsampled contourlet transformSignal Processing, 2009
- A region-based multi-sensor image fusion scheme using pulse-coupled neural networkPattern Recognition Letters, 2006