A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth
Open Access
- 1 May 2019
- journal article
- research article
- Published by Oxford University Press (OUP) in GigaScience
- Vol. 8 (5)
Abstract
Tracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS). We calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set. PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.Keywords
Funding Information
- Biotechnology and Biological Sciences Research Council (BB/N02334X/1, BB/M025551/1, BB/N005147/1)
- University of the West of England
- University of Edinburgh
This publication has 102 references indexed in Scilit:
- OSCILLATOR: A system for analysis of diurnal leaf growth using infrared photography combined with wavelet transformationPlant Methods, 2012
- Metabolism and Growth in Arabidopsis Depend on the Daytime Temperature but Are Temperature-Compensated against Cool NightsThe Plant Cell, 2012
- Precursor uptake assays and metabolic analyses in isolated tomato fruit chromoplastsPlant Methods, 2012
- Phenomics – technologies to relieve the phenotyping bottleneckTrends in Plant Science, 2011
- Effect of Rubisco Activase Deficiency on the Temperature Response of CO2 Assimilation Rate and Rubisco Activation State: Insights from Transgenic Tobacco with Reduced Amounts of Rubisco ActivasePlant Physiology, 2009
- Hormone- and Light-Mediated Regulation of Heat-Induced Differential Petiole Growth in ArabidopsisPlant Physiology, 2009
- Coordination of carbon supply and plant growthPlant, Cell & Environment, 2007
- Plant Circadian RhythmsThe Plant Cell, 2006
- The ELF4 gene controls circadian rhythms and flowering time in Arabidopsis thalianaNature, 2002
- LHY and CCA1 Are Partially Redundant Genes Required to Maintain Circadian Rhythms in ArabidopsisDevelopmental Cell, 2002