ViT-BT: Improving MRI Brain Tumor Classification Using Vision Transformer with Transfer Learning
Open Access
- 30 September 2024
- journal article
- Published by Blue Eyes Intelligence Engineering and Sciences Engineering and Sciences Publication (BEIESP) in International Journal of Soft Computing and Engineering
- Vol. 14 (4) , 16-26
Abstract
This paper presents a Vision Transformer designed for classifying brain tumors (ViT-BT), offering a novel methodology to enhance the classification of brain tumor MRI scans through transfer learning with Vision Transformers. Although traditional Convolutional Neural Networks (CNNs) have demonstrated significant capabilities in medical imaging, they often need help to grasp the global contextual information within images. To address this limitation, we utilize Vision Transformers, which excel at capturing long-range dependencies due to their self-attention mechanism. In the case of ViT-BT, the Vision Transformer model undergoes pre-training followed by fine-tuning on specific MRI brain tumor datasets, thereby improving its capability to classify various brain tumor types. Experimental results indicate that ViT-BT outperforms other CNN-based methods, delivering superior accuracy and resilience. Evaluations were performed using the BraTS 2023 dataset, comprising multi-modalMRI images of brain tumors, including T1-weighted, T2-weighted, T1CE, and Flair sequences. The ViT-BT model showcased remarkable performance, achieving precision, recall, F1-score, and accuracy rates of 97%, 99%, 99.41%, and 98.17%, respectively. This advancement is anticipated to significantly enhance diagnostic accuracy in clinical settings, ultimately leading to improved patient outcomes. The research underscores the potential of transfer learning with Vision Transformers in medical imaging as a promising avenue for future exploration across various medical domains.Keywords
This publication has 43 references indexed in Scilit:
- A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation2022
- Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images2022
- BiTr-Unet: A CNN-Transformer Combined Network for MRI Brain Tumor Segmentation2022
- TransBTS: Multimodal Brain Tumor Segmentation Using Transformer2021
- Multi-level attention network: application to brain tumor classificationSignal, Image and Video Processing, 2021
- An improved framework for brain tumor analysis using MRI based on YOLOv2 and convolutional neural networkComplex & Intelligent Systems, 2021
- DeepSeg: deep neural network framework for automatic brain tumor segmentation using magnetic resonance FLAIR imagesInternational Journal of Computer Assisted Radiology and Surgery, 2020
- Brain Tumor Segmentation Using Convolutional Neural Networks in MRI ImagesJournal of Medical Systems, 2019
- Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge2018
- Deep learning for segmentation of brain tumors: Impact of cross‐institutional training and testingMedical Physics, 2018