EMNet: A Novel Few-Shot Image Classification Model with Enhanced Self-Correlation Attention and Multi-Branch Joint Module
Open Access
- 1 January 2025
- journal article
- research article
- Published by MDPI AG in Biomimetics
- Vol. 10 (1) , 16
Abstract
In this research, inspired by the principles of biological visual attention mechanisms and swarm intelligence found in nature, we present an Enhanced Self-Correlation Attention and Multi-Branch Joint Module Network (EMNet), a novel model for few-shot image classification. Few-shot image classification aims to address the problem of image classification when data are limited. Traditional models require a large amount of labeled data for training, while few-shot learning trains models using only a small number of samples (just a few samples per class) to recognize new categories. EMNet shows its potential for bio-inspired algorithms in optimizing feature extraction and enhancing generalization capabilities. It features two key modules: Enhanced Self-Correlated Attention (ESCA) and Multi-Branch Joint Module (MBJ Module). EMNet tackles two main challenges in few-shot learning: how to make an effective important feature extraction and enhancement in images, and improving generalization to new categories. The ESCA module boosts the precision in extracting crucial local features, enhancing classification accuracy. The MBJ module focuses on shared features across images, emphasizing similarities within classes and subtle differences between them. This enhances model adaptability and generalization to new categories. Experimental results show that our model performs better than existing models in one-shot and five-shot tasks on mini-ImageNet, CUB-200, and CIFAR-FS datasets, which proves the proposed model to be an efficient end-to-end solution for few-shot image classification. In the five-way one-shot and five-way five-shot experiments on the CUB-200-2011 dataset, EMNet achieved classification accuracies that were 1.27 and 0.54 percentage points higher than those of RENet, respectively. In the five-way one-shot and five-way five-shot experiments on the miniImageNet dataset, EMNet’s classification accuracies were 0.02 and 0.48 percentage points higher than those of RENet, respectively. In the five-way one-shot and five-way five-shot experiments on the CIFAR-FS dataset, EMNet’s classification accuracies were 0.19 and 0.18 percentage points higher than those of RENet.Keywords
Funding Information
- National Natural Science Foundation of China (61977018, 62394330)
This publication has 18 references indexed in Scilit:
- Enhancing Few-Shot Image Classification With Cosine TransformerIEEE Access, 2023
- A Self-Attention Based Task-Adaptive Integration of Pre-trained Global and Local Classifiers for Few-Shot Classification2023
- Negative Margin Matters: Understanding Margin in Few-Shot Classification2020
- Multi-Scale Metric Learning for Few-Shot LearningIEEE Transactions on Circuits and Systems for Video Technology, 2020
- CBAM: Convolutional Block Attention Module2018
- Squeeze-and-Excitation Networks2018
- Learning to Compare: Relation Network for Few-Shot Learning2018
- Low-Shot Learning with Imprinted Weights2018
- Dynamic Few-Shot Visual Learning Without Forgetting2018
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015