Portrait Segmentation Using Ensemble of Heterogeneous Deep-Learning Models
Open Access
Abstract
Image segmentation plays a central role in a broad range of applications, such as medical image analysis, autonomous vehicles, video surveillance and augmented reality. Portrait segmentation, which is a subset of semantic image segmentation, is widely used as a preprocessing step in multiple applications such as security systems, entertainment applications, video conferences, etc. A substantial amount of deep learning-based portrait segmentation approaches have been developed, since the performance and accuracy of semantic image segmentation have improved significantly due to the recent introduction of deep learning technology. However, these approaches are limited to a single portrait segmentation model. In this paper, we propose a novel approach using an ensemble method by combining multiple heterogeneous deep-learning based portrait segmentation models to improve the segmentation performance. The Two-Models ensemble and Three-Models ensemble, using a simple soft voting method and weighted soft voting method, were experimented. Intersection over Union (IoU) metric, IoU standard deviation and false prediction rate were used to evaluate the performance. Cost efficiency was calculated to analyze the efficiency of segmentation. The experiment results show that the proposed ensemble approach can perform with higher accuracy and lower errors than single deep-learning-based portrait segmentation models. The results also show that the ensemble of deep-learning models typically increases the use of memory and computing power, although it also shows that the ensemble of deep-learning models can perform more efficiently than a single model with higher accuracy using less memory and less computing power.Keywords
Funding Information
- The Ministry of Small and Medium-sized Enterprises(SMEs) and Startups(MSS) (S2855401)
This publication has 37 references indexed in Scilit:
- Human Segmentation Based on Compressed Deep Convolutional Neural NetworkIEEE Access, 2020
- A review of semantic segmentation using deep neural networksInternational Journal of Multimedia Information Retrieval, 2017
- A Survey: Image Segmentation TechniquesInternational Journal of Future Computer and Communication, 2014
- Survey of contemporary trends in color image segmentationJournal of Electronic Imaging, 2012
- Edge Detection Techniques For Image SegmentationInternational Journal of Computer Science and Information Technology, 2011
- Research Review for Digital Image Segmentation TechniquesInternational Journal of Computer Science and Information Technology, 2011
- Unsupervised Polarimetric SAR Image Segmentation and Classification Using Region Growing With Edge PenaltyIEEE Transactions on Geoscience and Remote Sensing, 2011
- Contour Detection and Hierarchical Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Image segmentation techniquesComputer Vision, Graphics, and Image Processing, 1985
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1984