MedSpectralNet: A lightweight convolutional neural network architecture for multi-modal image classification
Open Access
- 27 April 2026
- journal article
- magnetic resonance-imaging
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 21 (4) , e0346128
Abstract
Medical image classification requires models that effectively capture both fine-grained local patterns and global anatomical structures while maintaining computational efficiency for clinical deployment. Although state-of-the-art models such as MedMamba utilize State-Space Models (SSMs) to balance accuracy and efficiency, their sequential operations limit parallelism and increase runtime. To overcome these limitations, we propose MedSpectralNet, a lightweight Convolutional Neural Network (CNN) architecture that approximates self-attention with linear complexity to efficiently extract multi-frequency features. The model introduces a dual-stream feature extractor that processes global and local information in parallel, and a ContextGate block that adaptively fuses multi-scale representations. MedSpectralNet is evaluated across six benchmark datasets from MedMNIST (including BloodMNIST, BreastMNIST, DermaMNIST, PneumoniaMNIST, OrganCMNIST, and OrganSMNIST), MedSpectralNet achieves an average accuracy of 93.7% on OrganCMNIST and 98.0% on BloodMNIST, showing 1–4.3% relative accuracy gains when compared to larger transformer-based models. Importantly, it delivers this performance with only 8.5 million parameters, representing approximately 60% fewer parameters than MedMamba-T, which requires 14.5 million parameters. MedSpectralNet has also achieved high AUC values up to 0.999 across multiple classes, demonstrating state-of-the-art accuracy with substantially reduced computational cost and improved parallelization, which makes MedSpectralNet well-suited for real-time and resource-constrained classification-based medical applications.Keywords
Funding Information
- Princess Nourah Bint Abdulrahman University (PNURSP2026R829)
This publication has 42 references indexed in Scilit:
- InceptionMamba: A Lightweight and Effective Model for Medical Image Classification Revealing Mamba’s Low-Frequency BiasNeural Processing Letters, 2026
- Medical image classification with KAN-integrated transformers and dilated neighborhood attentionApplied Soft Computing, 2025
- MobileNetV4: Universal Models for the Mobile Ecosystem2024
- Med-Former: A Transformer Based Architecture for Medical Image Classification2024
- Comparison of Vision Transformers and Convolutional Neural Networks in Medical Image Analysis: A Systematic ReviewJournal of Medical Systems, 2024
- Deep learning in pulmonary nodule detection and segmentation: a systematic reviewEuropean Radiology, 2024
- HiFuse: Hierarchical multi-scale feature fusion network for medical image classificationBiomedical Signal Processing and Control, 2023
- A Deep Learning based Scalable and Adaptive Feature Extraction Framework for Medical ImagesInformation Systems Frontiers, 2023
- EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications2023
- Google AutoML: Cloud Vision2019