Self-Supervised Data Generation for Precision Agriculture: Blending Simulated Environments with Real Imagery
Preprint
Abstract
In precision agriculture, the scarcity of labeled data and significant covariate shifts pose unique challenges for training machine learning models. This scarcity is particularly problematic due to the dynamic nature of the environment and the evolving appearance of agricultural subjects as living things. We propose a novel system for generating realistic synthetic data to address these challenges. Utilizing a vineyard simulator based on the Unity engine, our system employs a cut-and-paste technique with geometrical consistency considerations to produce accurate photo-realistic images and labels from synthetic environments to train detection algorithms. This approach generates diverse data samples across various viewpoints and lighting conditions. We demonstrate considerable performance improvements in training a state-of-the-art detector by applying our method to table grapes cultivation. The combination of techniques can be easily automated, an increasingly important consideration for adoption in agricultural practice.Keywords
All Related Versions
- Version 1, 2025-02-25, ArXiv
- Published version: , 71.
This publication has 15 references indexed in Scilit:
- AgriSORT: A Simple Online Real-time Tracking-by-Detection framework for robotics in precision agriculture2024
- Label-efficient learning in agriculture: A comprehensive reviewComputers and Electronics in Agriculture, 2023
- An autonomous spraying robot architecture for sucker management in large‐scale hazelnut orchardsJournal of Field Robotics, 2023
- Review and analysis of synthetic dataset generation methods and techniques for application in computer visionArtificial Intelligence Review, 2023
- A Survey of Robotic Harvesting Systems and Enabling TechnologiesJournal of Intelligent & Robotic Systems, 2023
- Weakly and semi-supervised detection, segmentation and tracking of table grapes with limited and noisy dataComputers and Electronics in Agriculture, 2023
- Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic reviewComputers and Electronics in Agriculture, 2022
- Generating artificial images of plant seedlings using generative adversarial networksBiosystems Engineering, 2019
- Data synthesis methods for semantic segmentation in agriculture: A Capsicum annuum datasetComputers and Electronics in Agriculture, 2018
- A review on the practice of big data analysis in agricultureComputers and Electronics in Agriculture, 2017