Hand–Eye Parameter Estimation Based on 3-D Observation of a Single Marker
- 4 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-14
Abstract
Hand–eye calibration (HEC) aims to determine the geometrical transformation between the camera and the robot, which is essential for vision-guided robotic (VGR) systems. On the one hand, the classic pose-based and the recent pixel-based HEC methods mainly focus on multipixel research for initializing or solving. However, in these multimarker cases, additional connector assembly and wide coverage area are not user-friendly in practical data collection operations. Furthermore, both accuracy and efficiency are not ideal due to the transition calculation of multimarker poses. On the other hand, with the development of 3-D sensing technology, 3-D position data can be obtained in increasing scenes. However, HEC research on 3-D observation is relatively insufficient, and previous position-based formulations ignore the relationship among parameters. Motivated by the above shortcomings, this article thoroughly investigates the hand–eye parameter estimation based on 3-D observation of a single marker. First, a uniform single-marker formulation is proposed. This formulation is unique in the optimization sense without factor-extraction variants and covers both the eye-in-hand and eye-to-hand configurations. Then, an analytical solution and an iterative solution are derived through different rotation treatments. It is worth noting that these solutions are in a consistent and compact form due to the precalculated variables and the equivalent transformation. Meanwhile, the solvability, estimation accuracy, and computational efficiency are discussed. Finally, comprehensive simulations and real-world experiments are provided to demonstrate the advantages of the proposed method over previous methods in terms of accuracy, computational efficiency, and operational efficiency. The codes and datasets are open source at: https://github.com/MatthewJin001/Single3D and https://github.com/MatthewJin001/3Ddata , respectively.Keywords
Funding Information
- National Natural Science Foundation of China (62103222, 61673265)
- National key research and development program (2020YFC1512203)
- Fundamental Research Funds for the Central Universities (2023MS030)
- Jiangsu Science and Technology Programme (BK20220283)
- Research Development Fund (RDF-20-01-08)
This publication has 25 references indexed in Scilit:
- Dual quaternion operations for rigid body motion and their application to the hand–eye calibrationMechanism and Machine Theory, 2023
- High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo visionInformation Fusion, 2022
- Marker‐less real‐time intra‐operative camera and hand‐eye calibration procedure for surgical augmented realityHealthcare Technology Letters, 2019
- Simultaneous robot-world and hand-eye calibration by the alternative linear programmingPattern Recognition Letters, 2019
- State Estimation for Robotics2017
- A computationally efficient method for hand–eye calibrationInternational Journal of Computer Assisted Radiology and Surgery, 2017
- Solving the robot-world hand-eye(s) calibration problem with iterative methodsMachine Vision and Applications, 2017
- Fast exact linear and non‐linear structural reanalysis and the Sherman–Morrison–Woodbury formulasInternational Journal for Numerical Methods in Engineering, 2001
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix ProductsJournal of the American Statistical Association, 1969