SynergyPose: Synergy Enhanced Feature and Projection Decoupling for 6-D Pose Estimation
- 5 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-16
Abstract
Estimating the 6D pose of texture-sparse objects is critical in vision-guided robotic manipulation and measurement. Existing single-RGB-based methods typically rely on multiple intermediate representations to improve accuracy, which increases computational and annotation costs. Alternatively, adopting a singular representation can mitigate these issues but it still suffers from feature scarcity, resulting in unreliable intermediate representation and pose estimation accuracy. Embracing these challenges, we propose a novel single-RGB-based framework named SynergyPose, which achieves accurate pose estimation of texture-sparse objects using only one intermediate representation. SynergyPose consists of three innovative components: Geometric Enhancer (GEer), Coordinate Projection Decoupling (CPD), and Consistency Constraint Loss (CCLoss). Specifically, we design a novel clustering branch based on feature aggregation and allocation within GEer, which synergistically extracts complementary features with a convolution branch to enhance feature representation. Based on the inter-projection coordinate consistency, we propose the CPD to capture the geometry of the object from different projection planes, which implicitly introduces multiple constraints to accurately calculate the dense correspondence without relying on other representations. Afterwards, CCLoss enforces coordinate consistency between the projection planes, explicitly introducing an additional constraint. Extensive experiments demonstrate the effectiveness of SynergyPose, which achieves competitive results on four BOP benchmark datasets.Keywords
Funding Information
- National Natural Science Foundation of China (U22A2058)
- National Natural Science Foundation of China (62176138)
- National Natural Science Foundation of China (62176136)
- National Key Research and Development Program of China (2018YFB1305300)
- Shandong Outstanding Youth Funding (ZR2023YQ054)
- shandong provincial key research and development program (2019JZZY010130)
- shandong provincial key research and development program (2020CXGC010207)
This publication has 59 references indexed in Scilit:
- InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction from Multi-view RGB-D ImagesInternational Journal of Computer Vision, 2024
- Cascaded feature fusion with multi-level self-attention mechanism for object detectionPattern Recognition, 2023
- Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimation2022
- Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Voting2022
- Neural Correspondence Field for Object Pose Estimation2022
- ER-Pose: Learning edge representation for 6D pose estimation of texture-less objectsNeurocomputing, 2022
- CosyPose: Consistent Multi-view Multi-object 6D Pose Estimation2020
- A Hybrid Approach for 6DoF Pose Estimation2020
- Learning 6D Object Pose Estimation Using 3D Object Coordinates2014
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008