Plant Root Phenotyping Using Deep Conditional GANs and Binary Semantic Segmentation
Open Access
Abstract
This paper develops an approach to perform binary semantic segmentation on Arabidopsis thaliana root images for plant root phenotyping using a conditional generative adversarial network (cGAN) to address pixel-wise class imbalance. Specifically, we use Pix2PixHD, an image-to-image translation cGAN, to generate realistic and high resolution images of plant roots and annotations similar to the original dataset. Furthermore, we use our trained cGAN to triple the size of our original root dataset to reduce pixel-wise class imbalance. We then feed both the original and generated datasets into SegNet to semantically segment the root pixels from the background. Furthermore, we postprocess our segmentation results to close small, apparent gaps along the main and lateral roots. Lastly, we present a comparison of our binary semantic segmentation approach with the state-of-the-art in root segmentation. Our efforts demonstrate that cGAN can produce realistic and high resolution root images, reduce pixel-wise class imbalance, and our segmentation model yields high testing accuracy (of over 99%), low cross entropy error (of less than 2%), high Dice Score (of near 0.80), and low inference time for near real-time processing.Keywords
Funding Information
- United States National Institute of Food and Agriculture (NIFA) (2020-67021-32461)
This publication has 29 references indexed in Scilit:
- SegRoot: A high throughput segmentation method for root image analysisComputers and Electronics in Agriculture, 2019
- Root Phenotyping for Drought Tolerance: A ReviewAgronomy, 2018
- High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs2018
- Image-to-Image Translation with Conditional Adversarial Networks2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Image-Based High-Throughput Field Phenotyping of Crop RootsPlant Physiology, 2014
- Recovering complete plant root system architectures from soil via X-ray μ-Computed TomographyPlant Methods, 2013
- Novel scanning procedure enabling the vectorization of entire rhizotron-grown root systemsPlant Methods, 2013
- User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliabilityNeuroImage, 2006