Deep Phenotyping: Deep Learning for Temporal Phenotype/Genotype Classification
Preprint
Abstract
High resolution and high throughput, genotype to phenotype studies in plants are underway to accelerate breeding of climate ready crops. Complex developmental phenotypes are observed by imaging a variety of accessions in different environment conditions, however extracting the genetically heritable traits is challenging. In the recent years, deep learning techniques and in particular Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and Long-Short Term Memories (LSTMs), have shown great success in visual data recognition, classification, and sequence learning tasks. In this paper, we proposed a CNN-LSTM framework for plant classification of various genotypes. Here, we exploit the power of deep CNNs for joint feature and classifier learning, within an automatic phenotyping scheme for genotype classification. Further, plant growth variation over time is also important in phenotyping their dynamic behavior. This was fed into the deep learning framework using LSTMs to model these temporal cues for different plant accessions. We generated a replicated dataset of four accessions of Arabidopsis and carried out automated phenotyping experiments. The results provide evidence of the benefits of our approach over using traditional hand-crafted image analysis features and other genotype classification frameworks. We also demonstrate that temporal information further improves the performance of the phenotype classification system.Keywords
All Related Versions
- Published version: Plant Methods, 14 (1), 1.
This publication has 69 references indexed in Scilit:
- Plant phenomics and high-throughput phenotyping: accelerating rice functional genomics using multidisciplinary technologiesCurrent Opinion in Plant Biology, 2013
- Inference Methods for CRFs with Co-occurrence StatisticsInternational Journal of Computer Vision, 2012
- An image classification approach to analyze the suppression of plant immunity by the human pathogen SalmonellaTyphimuriumBMC Bioinformatics, 2012
- Phenomics – technologies to relieve the phenotyping bottleneckTrends in Plant Science, 2011
- Plants Images Classification Based on Textural Features using Combined ClassifierInternational Journal of Computer Science and Information Technology, 2011
- A Comparative Experiment of Several Shape Methods in Recognizing PlantsInternational Journal of Computer Science and Information Technology, 2011
- HTPheno: An image analysis pipeline for high-throughput plant phenotypingBMC Bioinformatics, 2011
- leafprocessor: a new leaf phenotyping tool using contour bending energy and shape cluster analysisNew Phytologist, 2010
- "GrabCut"ACM Transactions on Graphics, 2004
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001