A High-Speed Low-Cost Hardware Implementation for Depth Estimation Using Disparity Fusion Method
Open Access
- 7 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 72850-72865
Abstract
Depth estimation using stereo images can be achieved by calculating the disparity values between the left and the right images captured by two parallel cameras. Reconstructing depth information from 2D images is crucial in many applications, such as self-driving vehicles and robot navigation. Furthermore, most of these applications are employed with resource-constrained devices and have real-time requirements. In this paper, a high-speed, low-cost hardware implementation for disparity estimation is proposed. We adopted the novel disparity fusion method in our architecture, which can significantly reduce the number of calculations in the overall process. A refinement method is also designed to reduce the error rate of the resulting depth map and improve the tolerance to light noise. The proposed algorithm was implemented with the Kintex-7 field-programmable gate array. Its performance was tested by using the Middlebury-Version 2 and -Version 3 datasets. The proposed algorithm provides an operating speed of 118 fps with an error rate of only 6.36%. Compared with other state-of-the-art designs used for similar applications, the proposed method can achieve a 34.6% reduction in the error rate while providing the highest speed with competitive hardware cost.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (110-2622-8-006-004-TA)
This publication has 22 references indexed in Scilit:
- Literature Survey on Stereo Vision Disparity Map AlgorithmsJournal of Sensors, 2015
- A Low-Cost Real-Time Embedded Stereo Vision System for Accurate Disparity Estimation Based on Guided Image FilteringIEEE Transactions on Computers, 2015
- Real-Time High-Quality Stereo Vision System in FPGAIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Kolmogorov and Zabih’s Graph Cuts Stereo Matching AlgorithmImage Processing On Line, 2014
- Hardware Acceleration for an Accurate Stereo Vision System Using Mini-Census Adaptive Support RegionACM Transactions on Embedded Computing Systems, 2014
- Fast and Accurate Stereo Vision System on FPGAACM Transactions on Reconfigurable Technology and Systems, 2014
- High-quality real-time hardware stereo matching based on guided image filtering2014
- Review of stereo vision algorithms and their suitability for resource-limited systemsJournal of Real-Time Image Processing, 2013
- Real-time stereo vision system using adaptive weight cost aggregation approachEURASIP Journal on Image and Video Processing, 2011
- Segmentation-Based Adaptive Support for Accurate Stereo Correspondence2007