Tiny-MobileNet-SE: A Hybrid Lightweight CNN Architecture for Resource-Constrained IoT Devices
Open Access
- 23 June 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 108389-108401
Abstract
Traditional Convolutional Neural Network (CNN) architectures face challenges in deployment on resource-constrained devices such as Internet of Things (IoT) platforms, mobile applications, and drones due to their computational intensity and memory requirements. This limitation motivates the development of lightweight models that maintain high performance with minimal resource consumption. This paper introduces Tiny MobileNetSE, a novel Hybrid CNN architecture designed for image classification tasks under critical resource constrained environments. This architecture integrates Squeeze-and-Excitation (SE) Blocks for adaptive feature recalibration, Batch Normalization (BN) for accelerated convergence, and applies knowledge distillation techniques from MobileNetV2 for enhanced feature generalization. We employed comprehensive experimentation to validate its performance across various metrics, including accuracy, number of parameters, and model size. Experimental results show that Tiny-MobileNet-SE achieved superior performance with a significantly reduced model size (0.72 MB) and a smaller number of parameters (482 K) compared to conventional lightweight CNNs, reaching up to 98.6% validation accuracy on real-world crop pest and disease datasets. This innovative architecture contributes to bridging the gap between computational efficiency and classification accuracy, enabling deep learning (DL) models to be deployed in small mobile, embedded, and IoT devices with minimized resource consumption.Keywords
This publication has 38 references indexed in Scilit:
- Early dementia detection and severity classification with deep SqueezeNet convolutional neural network using EEG images2024
- Deep learning models for digital image processing: a reviewArtificial Intelligence Review, 2024
- An improved SqueezeNet model for the diagnosis of lung cancer in CT scansMachine Learning with Applications, 2022
- A survey of modern deep learning based object detection modelsDigital Signal Processing, 2022
- IoT-Equipped and AI-Enabled Next Generation Smart Agriculture: A Critical Review, Current Challenges and Future TrendsIEEE Access, 2022
- Delving deep into spatial pooling for squeeze-and-excitation networksPattern Recognition, 2022
- Plant Disease Detection and Classification by Deep Learning—A ReviewIEEE Access, 2021
- Knowledge Distillation: A SurveyInternational Journal of Computer Vision, 2021
- Plant leaf disease classification using EfficientNet deep learning modelEcological Informatics, 2021
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998