Multi-Level Feature Aggregation-Based Joint Keypoint Detection and Description
Authors:
Open Access
- 1 January 2022
- journal article
- research article
- Published by Tech Science Press in Computers, Materials & Continua
- Vol. 73 (2) , 2529-2540
Abstract
Image keypoint detection and description is a popular method to find pixel-level connections between images, which is a basic and critical step in many computer vision tasks. The existing methods are far from optimal in terms of keypoint positioning accuracy and generation of robust and discriminative descriptors. This paper proposes a new end-to-end self-supervised training deep learning network. The network uses a backbone feature encoder to extract multi-level feature maps, then performs joint image keypoint detection and description in a forward pass. On the one hand, in order to enhance the localization accuracy of keypoints and restore the local shape structure, the detector detects keypoints on feature maps of the same resolution as the original image. On the other hand, in order to enhance the ability to percept local shape details, the network utilizes multi-level features to generate robust feature descriptors with rich local shape information. A detailed comparison with traditional feature-based methods Scale Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF) and deep learning methods on HPatches proves the effectiveness and robustness of the method proposed in this paper.Keywords
This publication has 13 references indexed in Scilit:
- A DQN-Based Cache Strategy for Mobile Edge NetworksComputers, Materials & Continua, 2022
- An efficient quantum image steganography protocol based on improved EMD algorithmQuantum Information Processing, 2021
- A Multi-Feature Learning Model with Enhanced Local Attention for Vehicle Re-IdentificationComputers, Materials & Continua, 2021
- Data Matching of Solar Images Super-Resolution Based on Deep LearningComputers, Materials & Continua, 2021
- A novel coherence-based quantum steganalysis protocolQuantum Information Processing, 2020
- User Scheduling and Resource Allocation in HetNets With Hybrid Energy Supply: An Actor-Critic Reinforcement Learning ApproachIEEE Transactions on Wireless Communications, 2017
- ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applicationsGeomorphology, 2012
- DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline StereoIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Multimodality image registration quality assurance for conformal three-dimensional treatment planningInternational Journal of Radiation Oncology - Biology - Physics (IJROBP), 2001