Three-Dimensional Point Cloud Reconstruction and Morphology Measurement Method for Greenhouse Plants Based on the Kinect Sensor Self-Calibration
Open Access
Abstract
Plant morphological data are an important basis for precision agriculture and plant phenomics. The three-dimensional (3D) geometric shape of plants is complex, and the 3D morphology of a plant changes relatively significantly during the full growth cycle. In order to make high-throughput measurements of the 3D morphological data of greenhouse plants, it is necessary to frequently adjust the relative position between the sensor and the plant. Therefore, it is necessary to frequently adjust the Kinect sensor position and consequently recalibrate the Kinect sensor during the full growth cycle of the plant, which significantly increases the tedium of the multiview 3D point cloud reconstruction process. A high-throughput 3D rapid greenhouse plant point cloud reconstruction method based on autonomous Kinect v2 sensor position calibration is proposed for 3D phenotyping greenhouse plants. Two red–green–blue–depth (RGB-D) images of the turntable surface are acquired by the Kinect v2 sensor. The central point and normal vector of the axis of rotation of the turntable are calculated automatically. The coordinate systems of RGB-D images captured at various view angles are unified based on the central point and normal vector of the axis of the turntable to achieve coarse registration. Then, the iterative closest point algorithm is used to perform multiview point cloud precise registration, thereby achieving rapid 3D point cloud reconstruction of the greenhouse plant. The greenhouse tomato plants were selected as measurement objects in this study. Research results show that the proposed 3D point cloud reconstruction method was highly accurate and stable in performance, and can be used to reconstruct 3D point clouds for high-throughput plant phenotyping analysis and to extract the morphological parameters of plants.Keywords
Funding Information
- Natural Science Foundation of Jiangsu Province (BK201707027, BK20150686)
- National Key R&D Program of China (2017YFD0701400)
- Fundamental Research Funds for the Central Universities (KYGX201703)
This publication has 42 references indexed in Scilit:
- Nondestructive measurement method for greenhouse cucumber parameters based on machine visionEngineering in Agriculture, Environment and Food, 2016
- Accuracy Analysis of a Multi-View Stereo Approach for Phenotyping of Tomato Plants at the Organ LevelSensors, 2015
- Recognition of clustered tomatoes based on binocular stereo visionComputers and Electronics in Agriculture, 2014
- High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plantsBiosystems Engineering, 2014
- Cell to whole-plant phenotyping: the best is yet to comeTrends in Plant Science, 2013
- Rapid Characterization of Vegetation Structure with a Microsoft Kinect SensorSensors, 2013
- Phenomics – technologies to relieve the phenotyping bottleneckTrends in Plant Science, 2011
- 3-D Modeling of Tomato Canopies Using a High-Resolution Portable Scanning Lidar for Extracting Structural InformationSensors, 2011
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- An efficient algorith for determining the convex hull of a finite planar setInformation Processing Letters, 1972