Foundation Models in Smart Agriculture: Basics, Opportunities, and Challenges
Preprint
Abstract
The past decade has witnessed the rapid development of ML and DL methodologies in agricultural systems, showcased by great successes in variety of agricultural applications. However, these conventional ML/DL models have certain limitations: They heavily rely on large, costly-to-acquire labeled datasets for training, require specialized expertise for development and maintenance, and are mostly tailored for specific tasks, thus lacking generalizability. Recently, foundation models have demonstrated remarkable successes in language and vision tasks across various domains. These models are trained on a vast amount of data from multiple domains and modalities. Once trained, they can accomplish versatile tasks with just minor fine-tuning and minimal task-specific labeled data. Despite their proven effectiveness and huge potential, there has been little exploration of applying FMs to agriculture fields. Therefore, this study aims to explore the potential of FMs in the field of smart agriculture. In particular, we present conceptual tools and technical background to facilitate the understanding of the problem space and uncover new research directions in this field. To this end, we first review recent FMs in the general computer science domain and categorize them into four categories: language FMs, vision FMs, multimodal FMs, and reinforcement learning FMs. Subsequently, we outline the process of developing agriculture FMs and discuss their potential applications in smart agriculture. We also discuss the unique challenges associated with developing AFMs, including model training, validation, and deployment. Through this study, we contribute to the advancement of AI in agriculture by introducing AFMs as a promising paradigm that can significantly mitigate the reliance on extensive labeled datasets and enhance the efficiency, effectiveness, and generalization of agricultural AI systems.Keywords
All Related Versions
This publication has 65 references indexed in Scilit:
- Leaf only SAM: A segment anything pipeline for zero-shot automated leaf segmentationSmart Agricultural Technology, 2024
- O2RNet: Occluder-occludee relational network for robust apple detection in clustered orchard environmentsSmart Agricultural Technology, 2023
- A review of three-dimensional vision techniques in food and agriculture applicationsSmart Agricultural Technology, 2023
- Smart breeding driven by advances in sequencing technologyModern Agriculture, 2023
- Machine learning in agriculture domain: A state-of-art surveyArtificial Intelligence in the Life Sciences, 2021
- A comprehensive survey on model compression and accelerationArtificial Intelligence Review, 2020
- Precision aquaculture: a short review on engineering innovationsAquaculture International, 2019
- A high‐resolution, multimodal data set for agricultural robotics: A Ladybird's‐eye view of BrassicaJournal of Field Robotics, 2019
- Big Data in Smart Farming – A reviewAgricultural Systems, 2017
- Agricultural robots for field operations: Concepts and componentsBiosystems Engineering, 2016