Method for 2D-3D Registration under Inverse Depth and Structural Semantic Constraints for Digital Twin City
Open Access
- 26 August 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (17) , 8543
Abstract
A digital twin city maps a virtual three-dimensional (3D) city model to the geographic information system, constructs a virtual world, and integrates real sensor data to achieve the purpose of virtual–real fusion. Focusing on the accuracy problem of vision sensor registration in the virtual digital twin city scene, this study proposes a 2D-3D registration method under inverse depth and structural semantic constraints. First, perspective and inverse depth images of the virtual scene were obtained by using perspective view and inverse-depth nascent technology, and then the structural semantic features were extracted by the two-line minimal solution set method. A simultaneous matching and pose estimation method under inverse depth and structural semantic constraints was proposed to achieve the 2D-3D registration of real images and virtual scenes. The experimental results show that the proposed method can effectively optimize the initial vision sensor pose and achieve high-precision registration in the digital twin scene, and the Z-coordinate error is reduced by 45%. An application experiment of monocular image multi-object spatial positioning was designed, which proved the practicability of this method, and the influence of model data error on registration accuracy was analyzed.Keywords
Funding Information
- the Natural Science Foundation of Henan Province (202300410536)
This publication has 34 references indexed in Scilit:
- Real-time pose estimation of a dynamic quadruped in GPS-denied environments for 24-hour operationThe International Journal of Robotics Research, 2015
- A Survey of Augmented RealityFoundations and Trends® in Human-Computer Interaction, 2015
- A survey of Hough TransformPattern Recognition, 2015
- Reconstruction of dense three-dimensional shapes for outdoor scenes from an image sequenceOptical Engineering, 2013
- LSD: a Line Segment DetectorImage Processing On Line, 2012
- Virtual Line Descriptor and Semi-Local Graph Matching Method for Reliable Feature Correspondence2012
- EDLines: A real-time line segment detector with a false detection controlPattern Recognition Letters, 2011
- Parametric optimization and optimal control using algebraic geometry methodsInternational Journal of Control, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Random Number Generation and Quasi-Monte Carlo Methods.Journal of the American Statistical Association, 1993