Hybrid 3D CNN–transformer model for early brain tumor detection with multi-modal magnetic resonance imaging
Open Access
- 1 October 2025
- journal article
- Published by Institute of Advanced Engineering and Science in Bulletin of Electrical Engineering and Informatics
- Vol. 14 (5) , 3923-3934
Abstract
Accurate and early diagnosis of brain tumors using multi-modal magnetic resonance imaging (MRI) remains a critical challenge due to tumor heterogeneity and complex spatial representation. This study proposes a novel hybrid deep learning framework that integrates a 3D convolutional neural network (3D CNN) with swin transformer blocks and an attention-based feature fusion module (ABFFM). The model leverages multi-modal MRI inputs—T1, T1Gd, T2, and fluid-attenuated inversion recovery (FLAIR)—and features a dual-branch classification head for binary tumor detection and multi-label tumor sub-region classification: enhancing tumor (ET), tumor core (TC), and whole tumor (WT). Experiments conducted on the BraTS2023-GLI dataset demonstrate that the proposed model achieves a superior classification accuracy of 96.51%, with precision of 97.98%, recall of 97.04%, and F1-score of 97.61%, outperforming state-of-the-art methods. Furthermore, intrinsic attention weights offer interpretability by highlighting modality-specific contributions. The proposed model establishes a clinically promising approach for brain tumor analysis, with strong implications for early diagnosis and treatment planning.Keywords
This publication has 22 references indexed in Scilit:
- Accurate brain tumor classification with STN-NAM in ResNet50 using MRIBulletin of Electrical Engineering and Informatics, 2025
- Gaussian filter and CNN based framework for accurate detection of brain tumor by analyzing MRI imagesBulletin of Electrical Engineering and Informatics, 2024
- RETRACTED ARTICLE: Brain tumor detection and classification in MRI using hybrid ViT and GRU model with explainable AI in Southern BangladeshScientific Reports, 2024
- Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with Resnet 50BMC Medical Imaging, 2024
- Employing deep learning and transfer learning for accurate brain tumor detectionScientific Reports, 2024
- Brain tumor detection from images and comparison with transfer learning methods and 3-layer CNNScientific Reports, 2024
- Deep learning for multi-grade brain tumor detection and classification: a prospective surveyMultimedia Tools and Applications, 2024
- MRI brain tumor detection using deep learning and machine learning approachesMeasurement: Sensors, 2024
- MRI-based brain tumor detection using convolutional deep learning methods and chosen machine learning techniquesBMC Medical Informatics and Decision Making, 2023
- Brain tumor detection and classification using machine learning: a comprehensive surveyComplex & Intelligent Systems, 2021