Plenoptic cameras in real-time robotics
- 14 February 2013
- journal article
- research article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 32 (2) , 206-217
Abstract
Real-time vision-based navigation is a difficult task largely due to the limited optical properties of single cameras that are usually mounted on robots. Multiple camera systems such as polydioptric sensors provide more efficient and precise solutions for autonomous navigation. They are particularly suitable for motion estimation because they allow one to formulate a linear optimization. These sensors capture the visual information in a more complete form called the plenoptic function that encodes the spatial and temporal light radiance of the scene. The polydioptric sensors are rarely used in robotics because they are usually thought to increase the amount of data produced and require more computational power. This paper shows that these cameras provide more accurate estimation results in mobile robotics navigation if designed properly. It also shows that a plenoptic vision sensor with a resolution ranging from 3 × 3 to 40 × 30 pixels camera, provides higher accuracy than a mono-SLAM running on a 320 × 240 pixels camera. The paper also gives a complete scheme to design usable real-time plenoptic cameras for mobile robotics applications by establishing the link between velocity, resolution and motion estimation accuracy. Finally, experiments on a mobile robot are shown allowing for a comparison between optimal plenoptic visual sensors and single high-resolution cameras. The estimation with the plenoptic sensor is more accurate than a monocular high-definition camera with a processing time 100 times lower.Keywords
This publication has 22 references indexed in Scilit:
- 1‐Point RANSAC for extended Kalman filtering: Application to real‐time structure from motion and visual odometryJournal of Field Robotics, 2010
- Focused plenoptic camera and renderingJournal of Electronic Imaging, 2010
- A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change2006
- A biomorphic digital image sensorIEEE Journal of Solid-State Circuits, 2003
- Influence of cues from the anterior medial eyes of virtual prey onPortia fimbriata, an araneophagic jumping spiderJournal of Experimental Biology, 2002
- Navigation in an autonomous flying robot by using a biologically inspired visual odometer2000
- Diffractive and Micro-Optics for Multiplex Imaging2000
- Light field rendering1996
- Single lens stereo with a plenoptic cameraIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers ChlorophanusZeitschrift für Naturforschung B, 1956