Large Language Models and Foundation Models in Smart Agriculture: Basics, Opportunities, and Challenges
Preprint
Abstract
The past decade has witnessed the rapid development and adoption of ML & DL methodologies in agricultural systems, showcased by great successes in agricultural applications. However, these conventional ML/DL models have certain limitations: they heavily rely on large, costly-to-acquire labeled datasets for training, require specialized expertise for development and maintenance, and are mostly tailored for specific tasks, thus lacking generalizability. Recently, large pre-trained models, also known as FMs, have demonstrated remarkable successes in language, vision, and decision-making tasks across various domains. These models are trained on a large amount of data from multiple domains and modalities. Once trained, they can accomplish versatile tasks with just minor fine-tuning and minimal task-specific labeled data. Despite their proven effectiveness and huge potential, there has been little exploration of applying FMs to agriculture AI. Thus, this study aims to explore the potential of FMs in the field of smart agriculture. In particular, conceptual tools and technical background are presented to help the understanding of the problem space and uncover new research directions. To this end, recent FMs in the general CS domain are reviewed, and the models are categorized into four categories: language FMs, vision FMs, multimodal FMs, and reinforcement learning FMs. Then, the steps of developing agriculture FMs (AFMs) are outlined and potential applications in smart agriculture are discussed. Moreover, challenges and risks associated with developing AFMs are discussed, including model training, validation, and deployment. In summary, the advancement of AI in agriculture is explored by introducing AFMs as a promising paradigm that can significantly mitigate the reliance on extensive labeled datasets and enhance the efficiency, effectiveness, and generalization of agricultural AI systems.Keywords
All Related Versions
This publication has 75 references indexed in Scilit:
- Leaf only SAM: A segment anything pipeline for zero-shot automated leaf segmentationSmart Agricultural Technology, 2024
- O2RNet: Occluder-occludee relational network for robust apple detection in clustered orchard environmentsSmart Agricultural Technology, 2023
- A review of three-dimensional vision techniques in food and agriculture applicationsSmart Agricultural Technology, 2023
- Smart breeding driven by advances in sequencing technologyModern Agriculture, 2023
- Review of agricultural IoT technologyArtificial Intelligence in Agriculture, 2022
- Machine learning in agriculture domain: A state-of-art surveyArtificial Intelligence in the Life Sciences, 2021
- A comprehensive survey on model compression and accelerationArtificial Intelligence Review, 2020
- Precision aquaculture: a short review on engineering innovationsAquaculture International, 2019
- A high‐resolution, multimodal data set for agricultural robotics: A Ladybird's‐eye view of BrassicaJournal of Field Robotics, 2019
- Big Data in Smart Farming – A reviewAgricultural Systems, 2017