Segment Anything for Comprehensive Analysis of Grapevine Cluster Architecture and Berry Properties
Open Access
- 29 May 2024
- journal article
- research article
- Published by Elsevier in Plant Phenomics
- Vol. 6, 0202
Abstract
Grape cluster architecture and compactness are complex traits influencing disease susceptibility, fruit quality, and yield. Evaluation methods for these traits include visual scoring, manual methodologies, and computer vision, with the latter being the most scalable approach. Most of the existing computer vision approaches for processing cluster images often rely on conventional segmentation or machine learning with extensive training and limited generalization. The Segment Anything Model (SAM), a novel foundation model trained on a massive image dataset, enables automated object segmentation without additional training. This study demonstrates out-of-the-box SAM’s high accuracy in identifying individual berries in 2-dimensional (2D) cluster images. Using this model, we managed to segment approximately 3,500 cluster images, generating over 150,000 berry masks, each linked with spatial coordinates within their clusters. The correlation between human-identified berries and SAM predictions was very strong (Pearson’s r2 = 0.96). Although the visible berry count in images typically underestimates the actual cluster berry count due to visibility issues, we demonstrated that this discrepancy could be adjusted using a linear regression model (adjusted R2 = 0.87). We emphasized the critical importance of the angle at which the cluster is imaged, noting its substantial effect on berry counts and architecture. We proposed different approaches in which berry location information facilitated the calculation of complex features related to cluster architecture and compactness. Finally, we discussed SAM’s potential integration into currently available pipelines for image generation and processing in vineyard conditions.Keywords
All Related Versions
Funding Information
- USDA-NIFA Specialty Crop Research Initiative (2022-51181-38240)
This publication has 31 references indexed in Scilit:
- Segment anything model for medical image analysis: An experimental studyMedical Image Analysis, 2023
- Evaluating and Mapping Grape Color Using Image-Based PhenotypingPlant Phenomics, 2020
- Characterizing 3D inflorescence architecture in grapevine using X-ray imaging and advanced morphometrics: implications for understanding cluster densityJournal of Experimental Botany, 2019
- Identification of co-located QTLs and genomic regions affecting grapevine cluster architectureTheoretical and Applied Genetics, 2018
- Vineyard Yield Estimation Based on the Analysis of High Resolution Images Obtained with Artificial Illumination at NightSensors, 2015
- Heritability and identification of QTLs and underlying candidate genes associated with the architecture of the grapevine cluster (Vitis vinifera L.)Theoretical and Applied Genetics, 2014
- Effects of Sunlight Exposure on Grapevine Powdery Mildew DevelopmentPhytopathology®, 2012
- Relationship Between Cluster Compactness and Bunch Rot in Vignoles GrapesPlant Disease, 2009
- QTL analysis for fruit yield components in table grapes (Vitis vinifera)Theoretical and Applied Genetics, 2005
- Effect of Cluster Tightness on Botrytis Bunch Rot in Six Chardonnay ClonesPlant Disease, 1998