Category-level object pose estimation via novel feature fusion and two-stage pose regression
- 24 June 2025
- journal article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 36 (7) , 076303
Abstract
Category-level object pose estimation has attracted attention in robotics and augmented reality, as it enables generalization to unseen instances within known categories. However, significant intra-category shape variations and the complexity of effectively integrating geometric and visual information pose challenges to accurate pose and size estimation in vision measurement. Leveraging the widespread availability of affordable RGB-D sensors, this study explores an effective strategy for extracting and fusing appearance and geometric features to improve estimation performance. We introduce a vision foundation model for robust appearance feature extraction and propose a novel point-to-patch feature fusion strategy that leverages pixel-wise RGB-D correspondence to concatenate patch-level appearance features with point-level geometric features. The estimation process follows a two-stage paradigm, where object translation and size are first predicted, followed by rotation estimation guided by an auxiliary branch designed to facilitate learning of rotation-aware transformations. The proposed method achieves state-of-the-art performance on the CAMERA25 and REAL275 datasets, with enhanced generalization on the Wild6D dataset. Additionally, it supports real-time inference at 34 FPS on a single NVIDIA RTX A6000 GPU.Keywords
This publication has 16 references indexed in Scilit:
- Efficient encoding and aligning viewpoints for 6D pose estimation of unseen industrial partsMeasurement Science and Technology, 2024
- CLIPose: Category-Level Object Pose Estimation With Pre-Trained Vision-Language KnowledgeIEEE Transactions on Circuits and Systems for Video Technology, 2024
- GPT-COPE: A Graph-Guided Point Transformer for Category-Level Object Pose EstimationIEEE Transactions on Circuits and Systems for Video Technology, 2023
- Learning geometric consistency and discrepancy for category-level 6D object pose estimation from point cloudsPattern Recognition, 2023
- 6D pose estimation of object based on fused region-level feature in cluttered scenesMeasurement Science and Technology, 2023
- Category-Level 6D Pose Estimation Using Geometry-Guided Instance-Aware Prior and Multi-Stage ReconstructionIEEE Robotics and Automation Letters, 2023
- ShAPO: Implicit Representations for Multi-object Shape, Appearance, and Pose Optimization2022
- Fault Diagnosis for Electro-Mechanical Actuators Based on STL-HSTA-GRU and SMIEEE Transactions on Instrumentation and Measurement, 2021
- 3D Mapping and 6D Pose Computation for Real Time Augmented Reality on Cylindrical ObjectsIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Least-squares estimation of transformation parameters between two point patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991