A Survey on Graph-Based Deep Learning for Computational Histopathology
Authors:
- David Ahmedt-AristizabalDADavid Ahmedt-Aristizabal
- Mohammad Ali ArminMAMohammad Ali Armin
- Simon DenmanSDSimon Denman
- Clinton FookesCFClinton Fookes
- Lars PeterssonLPLars Petersson
Preprint
Abstract
With the remarkable success of representation learning for prediction problems, we have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. However, learning over patch-wise features using convolutional neural networks limits the ability of the model to capture global contextual information and comprehensively model tissue composition. The phenotypical and topological distribution of constituent histological entities play a critical role in tissue diagnosis. As such, graph data representations and deep learning have attracted significant attention for encoding tissue representations, and capturing intra- and inter- entity level interactions. In this review, we provide a conceptual grounding for graph analytics in digital pathology, including entity-graph construction and graph architectures, and present their current success for tumor localization and classification, tumor invasion and staging, image retrieval, and survival prediction. We provide an overview of these methods in a systematic manner organized by the graph representation of the input image, scale, and organ on which they operate. We also outline the limitations of existing techniques, and suggest potential future research directions in this domain.Keywords
All Related Versions
This publication has 58 references indexed in Scilit:
- Deep learning powers cancer diagnosis in digital pathologyComputerized Medical Imaging and Graphics, 2021
- Cervical cell classification with graph convolutional networkComputer Methods and Programs in Biomedicine, 2021
- Going deeper through the Gleason scoring scale: An automatic end-to-end system for histology prostate grading and cribriform pattern detectionComputer Methods and Programs in Biomedicine, 2020
- Graph Attention Multi-instance Learning for Accurate Colorectal Cancer Staging2020
- Deep learning in digital pathology image analysis: a surveyFrontiers of Medicine, 2020
- Weakly- and Semi-supervised Graph CNN for Identifying Basal Cell Carcinoma on Pathological Images2019
- Encoding Histopathological WSIs Using GNN for Scalable Diagnostically Relevant Regions Retrieval2019
- PanNuke: An Open Pan-Cancer Histology Dataset for Nuclei Instance Segmentation and Classification2019
- Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images2018
- Graph CNN for Survival Analysis on Whole Slide Pathological Images2018