Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making
Preprint
Abstract
As a strategic pillar industry for human survival and development, modern agriculture faces dual challenges: optimizing production efficiency and achieving sustainable development. Against the backdrop of intensified climate change leading to frequent extreme weather events, the uncertainty risks in agricultural production systems are increasing exponentially. To address these challenges, this study proposes an innovative \textbf{M}ultimodal \textbf{A}gricultural \textbf{A}gent \textbf{A}rchitecture (\textbf{MA3}), which leverages cross-modal information fusion and task collaboration mechanisms to achieve intelligent agricultural decision-making. This study constructs a multimodal agricultural agent dataset encompassing five major tasks: classification, detection, Visual Question Answering (VQA), tool selection, and agent evaluation. We propose a unified backbone for sugarcane disease classification and detection tools, as well as a sugarcane disease expert model. By integrating an innovative tool selection module, we develop a multimodal agricultural agent capable of effectively performing tasks in classification, detection, and VQA. Furthermore, we introduce a multi-dimensional quantitative evaluation framework and conduct a comprehensive assessment of the entire architecture over our evaluation dataset, thereby verifying the practicality and robustness of MA3 in agricultural scenarios. This study provides new insights and methodologies for the development of agricultural agents, holding significant theoretical and practical implications. Our source code and dataset will be made publicly available upon acceptance.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Tool learning with large language models: a surveyFrontiers of Computer Science, 2025
- Enhancing sugarcane leaf disease classification through a novel hybrid shifted-vision transformer approach: technical insights and methodological advancementsEnvironmental Monitoring and Assessment, 2024
- Fertilizer management for global ammonia emission reductionNature, 2024
- T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step2024
- Large language models and agricultural extension servicesNature Food, 2023
- Crop switching can enhance environmental sustainability and farmer incomes in ChinaNature, 2023
- Toolformer: Language Models Can Teach Themselves to Use Tools2023
- API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs2023
- Ultrasensitive nano-gold labelled, duplex lateral flow immunochromatographic assay for early detection of sugarcane mosaic virusesScientific Reports, 2022
- Comparative genomics reveals insights into genetic variability and molecular evolution among sugarcane yellow leaf virus populationsScientific Reports, 2021