Potential roles of transformers in brain tumor diagnosis and treatment
Authors:
Open Access
Abstract
Brain tumor (BT) is one of many malignancies that have substantially enhanced global human morbidity and mortality rates. Early detection and characterization of glioma are essential for effective preventive strategies. Currently, the use of Transformers, a deep learning model for BT diagnosis and treatment, is attracting significant attention. The transformer self‐attention mechanism automatically learns the associations between input data for efficient processing and analysis. Research indicates that Transformers could play an essential role in the BT segmentation of magnetic resonance imaging (MRI) images, the MRI and histopathology‐based grading of brain cancer, BT molecular expression prediction, the classification of primary brain metastasis sites, voxel‐level dose and BT radiotherapy outcome prediction, synergistic prediction, and the pathway deconvolution of drug combinations. In this review, the feasibility, accuracy, and applicability of various algorithms are systematically analyzed and their prospects are discussed. Overall, this review aimed to discuss and provide an overview of the increasing applications of Transformers in real‐time BT detection and therapy, indicating their broad prospects and potential. In the future, Transformers are expected to be increasingly used for the diagnosis and subsequent treatment of BT because of the continuous development and improvement of Transformer‐based deep learning technology. However, more work is required to investigate their properties for anomaly detection, medical image classification, network design development, and application to other medical data.Keywords
Funding Information
- National Natural Science Foundation of China (82103480)
This publication has 92 references indexed in Scilit:
- DeepSynergy: predicting anti-cancer drug synergy with Deep LearningBioinformatics, 2017
- The 19th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2016)Medical Image Analysis, 2017
- Imaging Correlates of Adult Glioma GenotypesRadiology, 2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Multimodal MRI features predict isocitrate dehydrogenase genotype in high-grade gliomasNeuro-Oncology, 2016
- A Dataset for Breast Cancer Histopathological Image ClassificationIEEE Transactions on Biomedical Engineering, 2015
- Low-frequency quantitative ultrasound imaging of cell death in vivoMedical Physics, 2013
- Brain tumor epidemiology: Consensus from the Brain Tumor Epidemiology ConsortiumCancer, 2008
- Brain cancer diagnosis and therapy with nanoplatforms☆Advanced Drug Delivery Reviews, 2006
- Distribution of Brain MetastasesArchives of Neurology, 1988