A Unified Framework for Street-View Panorama Stitching
Open Access
Abstract
In this paper, we propose a unified framework to generate a pleasant and high-quality street-view panorama by stitching multiple panoramic images captured from the cameras mounted on the mobile platform. Our proposed framework is comprised of four major steps: image warping, color correction, optimal seam line detection and image blending. Since the input images are captured without a precisely common projection center from the scenes with the depth differences with respect to the cameras to different extents, such images cannot be precisely aligned in geometry. Therefore, an efficient image warping method based on the dense optical flow field is proposed to greatly suppress the influence of large geometric misalignment at first. Then, to lessen the influence of photometric inconsistencies caused by the illumination variations and different exposure settings, we propose an efficient color correction algorithm via matching extreme points of histograms to greatly decrease color differences between warped images. After that, the optimal seam lines between adjacent input images are detected via the graph cut energy minimization framework. At last, the Laplacian pyramid blending algorithm is applied to further eliminate the stitching artifacts along the optimal seam lines. Experimental results on a large set of challenging street-view panoramic images captured form the real world illustrate that the proposed system is capable of creating high-quality panoramas.Keywords
Funding Information
- National Natural Science Foundation of China (No. 41571436, No. 41271431)
- the Hubei Province Science and Technology Support Program, China (No. 2015BAA027)
- the Jiangsu Province Science and Technology Support Program, China (No. BE2014866)
- LIESMARS Special Research Funding
This publication has 51 references indexed in Scilit:
- SGM-based seamline determination for urban orthophoto mosaickingISPRS Journal of Photogrammetry and Remote Sensing, 2016
- A robust mosaicking procedure for high spatial resolution remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2015
- Seamline Determination Based on Segmentation for Urban Image MosaickingIEEE Geoscience and Remote Sensing Letters, 2013
- Automatic determination of seamlines for aerial image mosaicking based on vector roads aloneISPRS Journal of Photogrammetry and Remote Sensing, 2012
- Seam-line determination for image mosaicking: A technique minimizing the maximum local mismatch and the global costISPRS Journal of Photogrammetry and Remote Sensing, 2010
- Automatic Registration and Mosaicking for Airborne Multispectral Image SequencesPhotogrammetric Engineering & Remote Sensing, 2008
- Image Alignment and Stitching: A TutorialFoundations and Trends in Computer Graphics and Vision, 2007
- Morphological image compositingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Interactive digital photomontageACM Transactions on Graphics, 2004
- Seamline detection in colour orthoimage mosaicking by use of twin snakesISPRS Journal of Photogrammetry and Remote Sensing, 2001