M2F-Net: A Deep Learning-Based Multimodal Classification with High-Throughput Phenotyping for Identification of Overabundance of Fertilizers
Open Access
- 13 June 2023
- journal article
- research article
- Published by MDPI AG in Agriculture
- Vol. 13 (6) , 1238
Abstract
Amaranth, a pseudocereal crop which is rich in nutrients and climate resistant, can provide an opportunity to increase food security and nutritional content for the growing population. Farmers rely mainly on synthetic fertilizers to improve the quality and yield of the crop; however, this overuse harms the ecosystem. Understanding the mechanism causing this environmental deterioration is crucial for crop production and ecological sustainability. In recent years, high-throughput phenotyping using Artificial Intelligence (AI) has been thriving and can provide an effective solution for the identification of fertilizer overuse. Influenced by the strength of deep learning paradigms and IoT sensors, a novel multimodal fusion network (M2F-Net) is proposed for high-throughput phenotyping to diagnose overabundance of fertilizers. In this paper, we developed and analyzed three strategies that fuse agrometeorological and image data by assessing fusion at various stages. Initially two unimodal baseline networks were trained: Multi-Layer Perceptron (MLP) on agrometeorological data and a pre-trained Convolutional Neural Network (CNN) model DenseNet-121 on image data. With these baselines, the multimodal fusion network is developed, capable of adeptly learning from image and non-image data and the model’s performance is evaluated in terms of accuracy and Area Under Curve (AUC). Moreover, the fusion approaches that are considered outperformed the unimodal networks remarkably with 91% accuracy. From the experimental result, it is proven that incorporating agrometeorological information and images can substantially boost the classification performance for the overabundance of fertilizer.Keywords
This publication has 44 references indexed in Scilit:
- DeepFruits: A Fruit Detection System Using Deep Neural NetworksSensors, 2016
- Effects of Organic and Inorganic Fertilizers on the Growth of NH-Ae 47-4 Variety of OkraJournal of Applied Sciences and Environmental Management, 2016
- Accuracy Analysis of a Multi-View Stereo Approach for Phenotyping of Tomato Plants at the Organ LevelSensors, 2015
- Effect of Fertilizer Types on the Growth and Yield ofAmaranthus caudatusin Ilorin, Southern Guinea, Savanna Zone of NigeriaAdvances in Agriculture, 2014
- A Review of Imaging Techniques for Plant PhenotypingSensors, 2014
- The molecular basis of mutations at the Waxy locus from Amaranthus caudatus L.: evolution of the waxy phenotype in three species of grain amaranthMolecular Breeding, 2011
- Origin and evolution of the waxy phenotype in Amaranthus hypochondriacus: evidence from the genetic diversity in the Waxy locusMolecular Breeding, 2010
- Grain yield and protein concentration of two amaranth species (Amaranthus spp.) as influenced by the nitrogen fertilizationEuropean Journal of Agronomy, 2006
- Effects of growth light and nitrogen nutrition on the organization of the photosynthetic apparatus in leaves of a C4 plant, Amaranthus cruentusPlant, Cell & Environment, 2005
- Nitrogen Management in Furrow Irrigated, Ridge‐Tilled CornJournal of Production Agriculture, 1993