MEMORY EFFICIENT SEMI-GLOBAL MATCHING
Authors:
Open Access
- 23 July 2012
- journal article
- Published by Copernicus GmbH in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
- Vol. I-3, 371-376
Abstract
Semi-GlobalMatching (SGM) is a robust stereo method that has proven its usefulness in various applications ranging from aerial image matching to driver assistance systems. It supports pixelwise matching for maintaining sharp object boundaries and fine structures and can be implemented efficiently on different computation hardware. Furthermore, the method is not sensitive to the choice of parameters. The structure of the matching algorithm is well suited to be processed by highly paralleling hardware e.g. FPGAs and GPUs. The drawback of SGM is the temporary memory requirement that depends on the number of pixels and the disparity range. On the one hand this results in long idle times due to the bandwidth limitations of the external memory and on the other hand the capacity bounds are quickly reached. A full HD image with a size of 1920 × 1080 pixels and a disparity range of 512 pixels requires already 1 billion elements, which is at least several GB of RAM, depending on the element size, wich are not available at standard FPGA- and GPUboards. The novel memory efficient (eSGM) method is an advancement in which the amount of temporary memory only depends on the number of pixels and not on the disparity range. This permits matching of huge images in one piece and reduces the requirements of the memory bandwidth for real-time mobile robotics. The feature comes at the cost of 50% more compute operations as compared to SGM. This overhead is compensated by the previously idle compute logic within the FPGA and the GPU and therefore results in an overall performance increase. We show that eSGM produces the same high quality disparity images as SGM and demonstrate its performance both on an aerial image pair with 142 MPixel and within a real-time mobile robotic application. We have implemented the new method on the CPU, GPU and FPGA.We conclude that eSGM is advantageous for a GPU implementation and essential for an implementation on our FPGA.Keywords
This publication has 15 references indexed in Scilit:
- Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation2010
- Performance Evaluation of Stereo Algorithms for Automotive Applications2009
- A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching2009
- Stereo depth with a Unified Architecture GPU2008
- Mutual Information Based Semi-Global Stereo Matching on the GPU2008
- Efficient Belief Propagation for Early VisionInternational Journal of Computer Vision, 2006
- Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure2006
- Sub-Pixel Estimation Error Cancellation on Area-Based MatchingInternational Journal of Computer Vision, 2005
- High-accuracy stereo depth maps using structured light2003
- Computing visual correspondence with occlusions using graph cuts2002