Novel Method of Semantic Segmentation Applicable to Augmented Reality
Open Access
Abstract
This paper proposes a novel method of semantic segmentation, consisting of modified dilated residual network, atrous pyramid pooling module, and backpropagation, that is applicable to augmented reality (AR). In the proposed method, the modified dilated residual network extracts a feature map from the original images and maintains spatial information. The atrous pyramid pooling module places convolutions in parallel and layers feature maps in a pyramid shape to extract objects occupying small areas in the image; these are converted into one channel using a 1 × 1 convolution. Backpropagation compares the semantic segmentation obtained through convolution from the final feature map with the ground truth provided by a database. Losses can be reduced by applying backpropagation to the modified dilated residual network to change the weighting. The proposed method was compared with other methods on the Cityscapes and PASCAL VOC 2012 databases. The proposed method achieved accuracies of 82.8 and 89.8 mean intersection over union (mIOU) and frame rates of 61 and 64.3 frames per second (fps) for the Cityscapes and PASCAL VOC 2012 databases, respectively. These results prove the applicability of the proposed method for implementing natural AR applications at actual speeds because the frame rate is greater than 60 fps.Keywords
This publication has 29 references indexed in Scilit:
- Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Learning Deconvolution Network for Semantic Segmentation2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- A survey of vision-based methods for action representation, segmentation and recognitionComputer Vision and Image Understanding, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004