Mask Guided Matting via Progressive Refinement Network
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1154-1163
Abstract
We propose Mask Guided (MG) Matting, a robust matting framework that takes a general coarse mask as guidance. MG Matting leverages a network (PRN) design which encourages the matting model to provide self-guidance to progressively refine the uncertain regions through the decoding process. A series of guidance mask perturbation operations are also introduced in the training to further enhance its robustness to external guidance. We show that PRN can generalize to unseen types of guidance masks such as trimap and low-quality alpha matte, making it suitable for various application pipelines. In addition, we revisit the foreground color prediction problem for matting and propose a surprisingly simple improvement to address the dataset issue. Evaluation on real and synthetic benchmarks shows that MG Matting achieves state-of-the-art performance using various types of guidance inputs. Code and models are available at https://github.com/yucornetto/MGMatting.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Deep Residual Learning for Image Recognition2016
- Holistically-Nested Edge Detection2015
- Automatic trimap generation for digital image matting2013
- KNN MattingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Shared Sampling for Real‐Time Alpha MattingComputer Graphics Forum, 2010
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Spectral MattingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- A Closed-Form Solution to Natural Image MattingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Optimized Color Sampling for Robust Matting2007
- Poisson mattingACM Transactions on Graphics, 2004