Recent advances of Transformers in medical image analysis: A comprehensive review
Authors:
Open Access
- 24 March 2023
- journal article
- review article
- Published by Wiley in MedComm – Future Medicine
- Vol. 2 (1)
Abstract
Recent works have shown that Transformer's excellent performances on natural language processing tasks can be maintained on natural image analysis tasks. However, the complicated clinical settings in medical image analysis and varied disease properties bring new challenges for the use of Transformer. The computer vision and medical engineering communities have devoted significant effort to medical image analysis research based on Transformer with especial focus on scenario‐specific architectural variations. In this paper, we comprehensively review this rapidly developing area by covering the latest advances of Transformer‐based methods in medical image analysis of different settings. We first give introduction of basic mechanisms of Transformer including implementations of selfattention and typical architectures. The important research problems in various medical image data modalities, clinical visual tasks, organs and diseases are then reviewed systemically. We carefully collect 276 very recent works and 76 public medical image analysis datasets in an organized structure. Finally, discussions on open problems and future research directions are also provided. We expect this review to be an up‐to‐date roadmap and serve as a reference source in pursuit of boosting the development of medical image analysis field.Keywords
Funding Information
- National Natural Science Foundation of China (62172273)
This publication has 170 references indexed in Scilit:
- Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challengeMedical Image Analysis, 2017
- Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic featuresScientific Data, 2017
- Automated Breast Ultrasound Lesions Detection Using Convolutional Neural NetworksIEEE Journal of Biomedical and Health Informatics, 2017
- Gland segmentation in colon histology images: The glas challenge contestMedical Image Analysis, 2017
- Preparing a collection of radiology examinations for distribution and retrievalJournal of the American Medical Informatics Association, 2015
- WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physiciansComputerized Medical Imaging and Graphics, 2015
- The Cancer Genome Atlas Pan-Cancer analysis projectNature Genetics, 2013
- Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancerInternational Journal of Computer Assisted Radiology and Surgery, 2013
- The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information RepositoryJournal of Digital Imaging, 2013
- Multi-parametric neuroimaging reproducibility: A 3-T resource studyNeuroImage, 2011