Simultaneous Hand–Eye/Robot–World/Camera–IMU Calibration
- 11 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 27 (4) , 2278-2289
Abstract
The problem of calibrating an extrinsic parameter between a camera and an inertial measurement unit (IMU) using an industrial robotic manipulator has been studied. This generates a result of hand–eye/robot–world/camera–IMU calibration in a simultaneous fashion. The developed method is free of inertial integration over time and, thus, is robust to uncertain IMU biases. It is derived that the problem can be solved via a simultaneous optimization of hand–eye/robot–world/camera–IMU transformations. The resulted optimization is highly nonconvex on the special Euclidean group, and we give globally optimal solutions. Experiments verify that the proposed method is capable of estimating accurate calibration parameters. Comparative studies between representatives show the global optimality of the proposed method. The new simultaneous method is capable of conducting calibration of a robot/camera/IMU combination. The designed method guarantees the global optimality; thus, the accuracy is ensured. The developed globally optimal solutions will also be computationally efficient on modern industrial computers. Finally, we show that the proposed method can give accurate calibration results for a stereo/IMU sensor combination.Keywords
Funding Information
- General Research Fund of Research Grants Council Hong Kong (11210017)
- Research Grants Council Hong Kong (21202816)
This publication has 35 references indexed in Scilit:
- Automated Reasoning and Equation Solving with the Characteristic Set MethodJournal of Computer Science and Technology, 2006
- Robot Hand-Eye Calibration Using Structure-from-MotionThe International Journal of Robotics Research, 2001
- Hand-Eye Calibration Using Dual QuaternionsThe International Journal of Robotics Research, 1999
- Simultaneous robot-world and hand-eye calibrationIEEE Transactions on Robotics and Automation, 1998
- Camera assisted calibration of SCARA armsIEEE Robotics & Automation Magazine, 1996
- Simultaneous calibration of a robot and a hand-mounted cameraIEEE Transactions on Robotics and Automation, 1995
- Finding the Position and Orientation of a Sensor on a Robot Manipulator Using QuaternionsThe International Journal of Robotics Research, 1991
- A new technique for fully autonomous and efficient 3D robotics hand/eye calibrationIEEE Transactions on Robotics and Automation, 1989
- A New Development in Camera Calibration: Calibrating a Pair of Mobile CamerasThe International Journal of Robotics Research, 1987
- QuicksortThe Computer Journal, 1962