FPGA Accelerator for Stereo Vision using Semi-Global Matching through Dependency Relaxation
Authors:
- 1 August 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 304-309
Abstract
In this paper, we propose a fully parallel and pipelined architecture for stereo vision on FPGAs using Semi-Global Matching with Census Transform being used underneath. Further, we extend the above streaming architecture so that multiple pixels can be processed in a data parallel fashion. We expose this data parallelism through dependency relaxation. This establishes a trade-off between accuracy and throughput of the hardware. We tested the proposed architecture on Virtex-7 FPGA using KITTI 2012 and KITTI 2015 datasets. On images of resolution 1280x960, with 64 disparity levels, we are able to run our hardware design at 100 MHz. At this frequency, our design is able to process 322 frames per second which is 1.6 times faster than the state-of-the-art SGM implementation on FPGA. Our system can be scaled to a higher resolution image.Keywords
This publication has 13 references indexed in Scilit:
- Real-Time Low-Power FPGA Architecture for Stereo VisionIEEE Transactions on Circuits and Systems II: Express Briefs, 2017
- High throughput hardware architecture for accurate semi-global matching2017
- JOINT 3D ESTIMATION OF VEHICLES AND SCENE FLOWISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2015
- Real-Time High-Quality Stereo Vision System in FPGAIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Matching cost computation algorithm and high speed FPGA architecture for high quality real-time Semi Global Matching stereo vision for road scenes2014
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation2010
- Stereo Processing by Semiglobal Matching and Mutual InformationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Non-parametric techniques for fast and robust stereo matching2002
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002