Generalized Stereo Matching Method Based on Iterative Optimization of Hierarchical Graph Structure Consistency Cost for Urban 3D Reconstruction
Open Access
- 30 April 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (9) , 2369
Abstract
Generalized stereo matching faces the radiation difference and small ground feature difference brought by different satellites and different time phases, while the texture-less and disparity discontinuity phenomenon seriously affects the correspondence between matching points. To address the above problems, a novel generalized stereo matching method based on the iterative optimization of hierarchical graph structure consistency cost is proposed for urban 3D scene reconstruction. First, the self-similarity of images is used to construct k-nearest neighbor graphs. The left-view and right-view graph structures are mapped to the same neighborhood, and the graph structure consistency (GSC) cost is proposed to evaluate the similarity of the graph structures. Then, cross-scale cost aggregation is used to adaptively weight and combine multi-scale GSC costs. Next, object-based iterative optimization is proposed to optimize outliers in pixel-wise matching and mismatches in disparity discontinuity regions. The visibility term and the disparity discontinuity term are iterated to continuously detect occlusions and optimize the boundary disparity. Finally, fractal net evolution is used to optimize the disparity map. This paper verifies the effectiveness of the proposed method on a public US3D dataset and a self-made dataset, and compares it with state-of-the-art stereo matching methods.Keywords
Funding Information
- Natural Science Foundation of Heilongjiang Province (YQ2021F005, 6142A0103011)
- National Key Laboratory of Science and Technology on Remote Sensing Information and Image Analysis Foundation Project (YQ2021F005, 6142A0103011)
This publication has 48 references indexed in Scilit:
- Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle ImageryRemote Sensing, 2016
- Cross-scale cost aggregation for stereo matchingIEEE Transactions on Circuits and Systems for Video Technology, 2015
- MeshStereo: A Global Stereo Model with Mesh Alignment Regularization for View Interpolation2015
- Robust stereo matching using adaptive random walk with restart algorithmImage and Vision Computing, 2015
- Accurate Stereo Matching by Two-Step Energy MinimizationIEEE Transactions on Image Processing, 2015
- Fast Cost-Volume Filtering for Visual Correspondence and BeyondIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- FULLY AUTOMATED GENERATION OF ACCURATE DIGITAL SURFACE MODELS WITH SUB-METER RESOLUTION FROM SATELLITE IMAGERYThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012
- A new Tikhonov regularization methodNumerical Algorithms, 2011
- Accuracy assessment of digital elevation models by means of robust statistical methodsISPRS Journal of Photogrammetry and Remote Sensing, 2009
- Stereo matching using belief propagationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003