Abstract
Estimating the 6D pose of texture-sparse objects is critical in vision-guided robotic manipulation and measurement. Existing single-RGB-based methods typically rely on multiple intermediate representations to improve accuracy, which increases computational and annotation costs. Alternatively, adopting a singular representation can mitigate these issues but it still suffers from feature scarcity, resulting in unreliable intermediate representation and pose estimation accuracy. Embracing these challenges, we propose a novel single-RGB-based framework named SynergyPose, which achieves accurate pose estimation of texture-sparse objects using only one intermediate representation. SynergyPose consists of three innovative components: Geometric Enhancer (GEer), Coordinate Projection Decoupling (CPD), and Consistency Constraint Loss (CCLoss). Specifically, we design a novel clustering branch based on feature aggregation and allocation within GEer, which synergistically extracts complementary features with a convolution branch to enhance feature representation. Based on the inter-projection coordinate consistency, we propose the CPD to capture the geometry of the object from different projection planes, which implicitly introduces multiple constraints to accurately calculate the dense correspondence without relying on other representations. Afterwards, CCLoss enforces coordinate consistency between the projection planes, explicitly introducing an additional constraint. Extensive experiments demonstrate the effectiveness of SynergyPose, which achieves competitive results on four BOP benchmark datasets.
Funding Information
  • National Natural Science Foundation of China (U22A2058)
  • National Natural Science Foundation of China (62176138)
  • National Natural Science Foundation of China (62176136)
  • National Key Research and Development Program of China (2018YFB1305300)
  • Shandong Outstanding Youth Funding (ZR2023YQ054)
  • shandong provincial key research and development program (2019JZZY010130)
  • shandong provincial key research and development program (2020CXGC010207)