Learning Affine Correspondences by Integrating Geometric Constraints
Authors:
- Zhenbao YuZhenbao Yu
- Qifeng YuQYQifeng Yu
- Daniel BarathDaniel Barath
Preprint
Abstract
Affine correspondences have received significant attention due to their benefits in tasks like image matching and pose estimation. Existing methods for extracting affine correspondences still have many limitations in terms of performance; thus, exploring a new paradigm is crucial. In this paper, we present a new pipeline designed for extracting accurate affine correspondences by integrating dense matching and geometric constraints. Specifically, a novel extraction framework is introduced, with the aid of dense matching and a novel keypoint scale and orientation estimator. For this purpose, we propose loss functions based on geometric constraints, which can effectively improve accuracy by supervising neural networks to learn feature geometry. The experimental show that the accuracy and robustness of our method outperform the existing ones in image matching tasks. To further demonstrate the effectiveness of the proposed method, we applied it to relative pose estimation. Affine correspondences extracted by our method lead to more accurate poses than the baselines on a range of real-world datasets. The code is available at https://github.com/stilcrad/DenseAffine.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Globally Optimal Solution to the Generalized Relative Pose Estimation Problem Using Affine CorrespondencesIEEE Transactions on Circuits and Systems for Video Technology, 2024
- Local feature matching using deep learning: A surveyInformation Fusion, 2024
- On Making SIFT Features Affine CovariantInternational Journal of Computer Vision, 2023
- Image Matching Across Wide Baselines: From Paper to PracticeInternational Journal of Computer Vision, 2020
- Boosting Feature Matching Accuracy With Pairwise Affine EstimationIEEE Transactions on Image Processing, 2020
- Efficient Recovery of Essential Matrix From Two Affine CorrespondencesIEEE Transactions on Image Processing, 2018
- A theory of point-wise homography estimationPattern Recognition Letters, 2017
- MODS: Fast and robust method for two-view matchingComputer Vision and Image Understanding, 2015
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Robust wide-baseline stereo from maximally stable extremal regionsImage and Vision Computing, 2004