Kernel Attention Transformer for Histopathology Whole Slide Image Analysis and Assistant Cancer Diagnosis
- 5 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 42 (9) , 2726-2739
Abstract
Transformer has been widely used in histopathology whole slide image analysis. However, the design of token-wise self-attention and positional embedding strategy in the common Transformer limits its effectiveness and efficiency when applied to gigapixel histopathology images. In this paper, we propose a novel kernel attention Transformer (KAT) for histopathology WSI analysis and assistant cancer diagnosis. The information transmission in KAT is achieved by cross-attention between the patch features and a set of kernels related to the spatial relationship of the patches on the whole slide images. Compared to the common Transformer structure, KAT can extract the hierarchical context information of the local regions of the WSI and provide diversified diagnosis information. Meanwhile, the kernel-based cross-attention paradigm significantly reduces the computational amount. The proposed method was evaluated on three large-scale datasets and was compared with 8 state-of-the-art methods. The experimental results have demonstrated the proposed KAT is effective and efficient in the task of histopathology WSI analysis and is superior to the state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62171007, 61901018, 61906058)
- Anhui Provincial Natural Science Foundation (1908085MF210)
- Project 111 (B13003)
- Fundamental Research Funds for the Central Universities of China (JZ2022HGTB0285)
This publication has 56 references indexed in Scilit:
- Graph CNN for Survival Analysis on Whole Slide Pathological Images2018
- From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 ChallengeIEEE Transactions on Medical Imaging, 2018
- Histopathological Whole Slide Image Analysis Using Context-Based CBIRIEEE Transactions on Medical Imaging, 2018
- Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast CancerJAMA, 2017
- Multi-Instance Multi-Label Learning for Multi-Class Classification of Whole Slide Breast Histopathology ImagesIEEE Transactions on Medical Imaging, 2017
- Deep Residual Learning for Image Recognition2016
- Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Hybrid speech recognition with Deep Bidirectional LSTM2013