3D modelling of leaves from color and ToF data for robotized plant measuring
- 1 May 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 3408-3414
Abstract
Supervision of long-lasting extensive botanic experiments is a promising robotic application that some recent technological advances have made feasible. Plant modelling for this application has strong demands, particularly in what concerns 3D information gathering and speed. This paper shows that Time-of-Flight (ToF) cameras achieve a good compromise between both demands, providing a suitable complement to color vision. A new method is proposed to segment plant images into their composite surface patches by combining hierarchical color segmentation with quadratic surface fitting using ToF depth data. Experimentation shows that the interpolated depth maps derived from the obtained surfaces fit well the original scenes. Moreover, candidate leaves to be approached by a measuring instrument are ranked, and then robot-mounted cameras move closer to them to validate their suitability to being sampled. Some ambiguities arising from leaves overlap or occlusions are cleared up in this way. The work is a proof-of-concept that dense color data combined with sparse depth as provided by a ToF camera yields a good enough 3D approximation for automated plant measuring at the high throughput imposed by the application.Keywords
This publication has 10 references indexed in Scilit:
- Lock-in Time-of-Flight (ToF) Cameras: A SurveyIEEE Sensors Journal, 2011
- Object modeling using a ToF camera under an uncertainty reduction approach2010
- Perception for mobile manipulation and grasping using active stereo2009
- Disparity from stereo-segment silhouettes of weakly-textured images2009
- Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking2009
- ToF-sensors: New dimensions for realism and interactivity2008
- Plant Growth Modelling and Applications: The Increasing Importance of Plant Architecture in Growth ModelsAnnals of Botany, 2007
- Physically Based Deformable Models in Computer GraphicsComputer Graphics Forum, 2006
- Image-based plant modeling2006
- 3D Pose Estimation of Cactus Leaves using an Active Shape Model2005