An α-Matte Boundary Defocus Model Based Cascaded Network for Multi-focus Image Fusion
Authors:
- Haoyu MaHMHaoyu Ma
- Qingmin LiaoQLQingmin Liao
- Juncheng ZhangJZJuncheng Zhang
- Shaojun LiuSLShaojun Liu
- Jing-Hao XueJXJing-Hao Xue
Preprint
Abstract
Capturing an all-in-focus image with a single camera is difficult since the depth of field of the camera is usually limited. An alternative method to obtain the all-in-focus image is to fuse several images focusing at different depths. However, existing multi-focus image fusion methods cannot obtain clear results for areas near the focused/defocused boundary (FDB). In this paper, a novel {\alpha}-matte boundary defocus model is proposed to generate realistic training data with the defocus spread effect precisely modeled, especially for areas near the FDB. Based on this {\alpha}-matte defocus model and the generated data, a cascaded boundary aware convolutional network termed MMF-Net is proposed and trained, aiming to achieve clearer fusion results around the FDB. More specifically, the MMF-Net consists of two cascaded sub-nets for initial fusion and boundary fusion, respectively; these two sub-nets are designed to first obtain a guidance map of FDB and then refine the fusion near the FDB. Experiments demonstrate that with the help of the new {\alpha}-matte boundary defocus model, the proposed MMF-Net outperforms the state-of-the-art methods both qualitatively and quantitatively.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- SESF-Fuse: an unsupervised deep model for multi-focus image fusionNeural Computing and Applications, 2020
- Pixel convolutional neural network for multi-focus image fusionInformation Sciences, 2018
- Multi-focus image fusion with a deep convolutional neural networkInformation Fusion, 2017
- A general framework for image fusion based on multi-scale transform and sparse representationInformation Fusion, 2015
- Multi-focus image fusion with dense SIFTInformation Fusion, 2015
- Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decompositionOptics Communications, 2015
- Microsoft COCO: Common Objects in Context2014
- Defocus map estimation from a single imagePattern Recognition, 2011
- Multi-focus image fusion using PCNNPattern Recognition, 2010
- A region-based multi-sensor image fusion scheme using pulse-coupled neural networkPattern Recognition Letters, 2006