Crop Growth Analysis Using Automatic Annotations and Transfer Learning in Multi-Date Aerial Images and Ortho-Mosaics
Open Access
Abstract
Growth monitoring of crops is a crucial aspect of precision agriculture, essential for optimal yield prediction and resource allocation. Traditional crop growth monitoring methods are labor-intensive and prone to errors. This study introduces an automated segmentation pipeline utilizing multi-date aerial images and ortho-mosaics to monitor the growth of cauliflower crops (Brassica Oleracea var. Botrytis) using an object-based image analysis approach. The methodology employs YOLOv8, a Grounding Detection Transformer with Improved Denoising Anchor Boxes (DINO), and the Segment Anything Model (SAM) for automatic annotation and segmentation. The YOLOv8 model was trained using aerial image datasets, which then facilitated the training of the Grounded Segment Anything Model framework. This approach generated automatic annotations and segmentation masks, classifying crop rows for temporal monitoring and growth estimation. The study’s findings utilized a multi-modal monitoring approach to highlight the efficiency of this automated system in providing accurate crop growth analysis, promoting informed decision-making in crop management and sustainable agricultural practices. The results indicate consistent and comparable growth patterns between aerial images and ortho-mosaics, with significant periods of rapid expansion and minor fluctuations over time. The results also indicated a correlation between the time and method of observation which paves a future possibility of integration of such techniques aimed at increasing the accuracy in crop growth monitoring based on automatically derived temporal crop row segmentation masks.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- GobhiSet: Dataset of raw, manually, and automatically annotated RGB images across phenology of Brassica oleracea var. BotrytisData in Brief, 2024
- RafanoSet: Dataset of raw, manually, and automatically annotated Raphanus Raphanistrum weed images for object detection and segmentation.Data in Brief, 2024
- Detection and segmentation of lettuce seedlings from seedling-growing tray imagery using an improved mask R-CNN methodSmart Agricultural Technology, 2024
- Transfer learning in environmental remote sensingRemote Sensing of Environment, 2023
- The Segment Anything Model (SAM) for remote sensing applications: From zero to one shotInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Agro-geoinformatics2021
- Crop Simulation Models as Decision-Supporting Tools for Sustainable Potato Production: a ReviewPotato Research, 2020
- Intelligent Agriculture - Agricultural Monitoring and Control Management System2020
- Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data.Psychological Methods, 2016
- Relative plant growth revisited: Towards a mathematical standardisation of separate approachesEcological Modelling, 2016