Comparison of Mask-R-CNN and Thresholding-Based Segmentation for High-Throughput Phenotyping of Walnut Kernel Color
Open Access
Abstract
High-throughput phenotyping has become essential for plant breeding programs, replacing traditional methods that rely on subjective scales influenced by human judgment. Machine learning (ML) computer vision systems have successfully used convolutional neural networks (CNNs) for image segmentation, providing greater flexibility than thresholding methods that may require carefully staged images. This study compares two quantitative image analysis methods, rule-based thresholding using the magick package in R and an instance-segmentation pipeline based on the widely used Mask-R-CNN architecture, and then compares the output of each to two different sets of human evaluations. Walnuts were collected over three years from over 3000 individual trees maintained by the UC Davis walnut breeding program. The resulting 90,961 kernels were placed into 100-cell trays and imaged using a 20-megapixel Basler camera with a Sony IMX183 sensor. Quantitative data from both image analysis methods were highly correlated for both lightness (L*; r2 = 0.997) and size (r2 = 0.984). The thresholding method required many manual adjustments to account for minor discrepancies in staging, while the CNN method was robust after a rapid initial training on only 13 images. The two human scoring methods were not highly correlated with the image analysis methods or with each other. Pixel classification provides data similar to human color assessments but offers greater consistency across different years. The thresholding approach offers flexibility and has been applied to other color-based phenotyping tasks, while the CNN approach can be adapted to images that are not perfectly staged and be retrained to quantify more subtle kernel characteristics such as spotting and shrivel.Keywords
Funding Information
- California Walnut Board
This publication has 50 references indexed in Scilit:
- YOLO-ALDS: an instance segmentation framework for tomato defect segmentation and grading based on active learning and improved YOLO11Computers and Electronics in Agriculture, 2025
- A hybrid CNN-Transformer model for identification of wheat varieties and growth stages using high-throughput phenotypingComputers and Electronics in Agriculture, 2024
- Non‑invasive leaf hydration status determination through convolutional neural networks based on multispectral images in chrysanthemumPlant Growth Regulation, 2023
- Machine learning-based approach: global trends, research directions, and regulatory standpointsData Science and Management, 2021
- Employment of artificial neural networks for non-invasive estimation of leaf water status using color features: a case study in Spathiphyllum wallisiiActa Physiologiae Plantarum, 2021
- Ripeness Classification of Bananas Using an Artificial Neural NetworkArabian Journal for Science and Engineering, 2019
- Recognising blueberry fruit of different maturity using histogram oriented gradients and colour features in outdoor scenesBiosystems Engineering, 2018
- A new approach for visual identification of orange varieties using neural networks and metaheuristic algorithmsInformation Processing in Agriculture, 2018
- Effect of different ripening stages on walnut kernel quality: antioxidant activities, lipid characterization and antibacterial propertiesJournal of Food Science and Technology, 2017
- Computer vision-based apple grading for golden delicious apples based on surface featuresInformation Processing in Agriculture, 2017