Hybrid deep learning-based multimodal framework for plant leaf disease classification using RGB, Excess Green (ExG), and pseudo-thermal representations with MobileNetV2
Authors:
Open Access
- 21 May 2026
- journal article
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1)
Abstract
Plant diseases are a serious danger to the world’s food security, because they lower agricultural output and increase economic losses. Due to subjectivity, fluctuating lighting, and environmental unpredictability, traditional visual examination techniques are frequently incorrect. The Excess Green (ExG) vegetation index and pseudo-thermal representations produced from RGB pictures are two synthetically developed complementary representations that are integrated with RGB imagery in this study’s lightweight multimodal deep learning system to address these issues. Histogram shifting and pseudo-infrared color mapping are used in a reproducible picture alteration pipeline to create the pseudo-thermal modality, which allows for extra visual signals without the need for specific thermal sensors. In order to classify plant diseases while preserving computational efficiency, the suggested framework uses MobileNetV3-Small backbones to extract modality-specific characteristics. This is followed by feature-level fusion. The publicly accessible Ginger Leaf Dataset, which includes RGB pictures of ginger leaves in four different conditions—Damage-Pest, Dehydrated, Healthy, and Leaf-blight—was used for the experiments. For training, validation, and testing, the dataset was split using a stratified 70:15:15 split. Python-based preprocessing procedures were used to create the extra modalities (ExG and pseudo-thermal representations) from the original RGB images. The experimental results show that the combination of the representations with RGB images can enhance the classification performance compared with the unimodal RGB-based models. Ablation experiments are also conducted to examine the contributions of different modalities to the overall categorization accuracy. The experimental results show that plant disease recognition can be improved with the help of efficient computing by combining lightweight convolutional neural networks with computationally generated visual representations.Keywords
Funding Information
- Manipal Academy of Higher Education, Manipal
This publication has 61 references indexed in Scilit:
- Spatial attention-based hybrid VGG-SVM and VGG-RF frameworks for improved cotton leaf disease detectionNeural Computing and Applications, 2025
- Intelligent leaf disease diagnosis: image algorithms using Swin Transformer and federated learningThe Visual Computer, 2024
- A systematic review of deep learning techniques for plant diseasesArtificial Intelligence Review, 2024
- Deep learning-based classification and application test of multiple crop leaf diseases using transfer learning and the attention mechanismComputing, 2024
- The Impacts of Chitosan on Plant Root Systems and Its Potential to be Used for Controlling Fungal Diseases in AgricultureJournal of Plant Growth Regulation, 2024
- A review on endophytic fungi: a potent reservoir of bioactive metabolites with special emphasis on blight disease managementArchives of Microbiology, 2024
- Spot-out fruit fly algorithm with simulated annealing optimized SVM for detecting tomato plant diseasesNeural Computing and Applications, 2023
- Deep learning system for paddy plant disease detection and classificationEnvironmental Monitoring and Assessment, 2022
- Bio-Fabricated Silver Nanoparticles: A Sustainable Approach for Augmentation of Plant Growth and Pathogen Control2021
- Attenuated plant viruses: preventing virus diseases and understanding the molecular mechanismJournal of General Plant Pathology, 2011