Dual-Hemispherical Photometric Visual Servoing
- 8 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (5) , 4170-4177
Abstract
It is well established that wide field of view cameras, as well as using the whole photometric information contained in images, offer many advantages for visual servoing. Therefore, we propose to extend the photometric visual servoing to full spherical cameras. More precisely, we are dealing with 360-degree optical rigs composed of two wide-angle lenses oriented in opposite directions that capture everything around the device in one acquisition. The photometric visual feature coupled to dual-hemispherical acquisitions that contain the whole surrounding scene provide useful complementary information, showing large convergence domains, straighter camera trajectories than with a single hemispherical camera, and high accuracy. We report thorough simulations and several challenging real experiments using a 6 degrees-of-freedom robotic arm controlled from dual-hemispherical acquisitions.Keywords
Funding Information
- AIST, ITH Department International Collaboration (R3-I-02, 2021-2025)
This publication has 24 references indexed in Scilit:
- Deep Reinforcement Learning with Omnidirectional Images: application to UAV Navigation in Forests2022
- Direct 3D model-based tracking in omnidirectional images robust to large inter-frame motion2021
- Panoramic SLAM from a multiple fisheye camera rigISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Visual Servoing on the Generalized Voronoi Diagram Using an Omnidirectional CameraJournal of Intelligent & Robotic Systems, 2018
- Omnidirectional visual obstacle detection using embedded FPGA2015
- Photometric visual servoing for omnidirectional camerasAutonomous Robots, 2013
- Manipulator control by using servoing with the stereo vision2002
- Visual Servoing/Tracking Using Central Catadioptric Images2002
- A new partitioned approach to image-based visual servo controlIEEE Transactions on Robotics and Automation, 2001
- A new technique for fully autonomous and efficient 3D robotics hand/eye calibrationIEEE Transactions on Robotics and Automation, 1989