High‐Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self‐Supervised Feature Representation
Open Access
- 21 August 2022
- journal article
- research article
- Published by Wiley in BioMed Research International
- Vol. 2022 (1) , 8007713
Abstract
Applying machine learning technology to automatic image analysis and auxiliary diagnosis of whole slide image (WSI) may help to improve the efficiency, objectivity, and consistency of pathological diagnosis. Due to its extremely high resolution, it is still a great challenge to directly process WSI through deep neural networks. In this paper, we propose a novel model for the task of classification of WSIs. The model is composed of two parts. The first part is a self‐supervised encoding network with a UNet‐like architecture. Each patch from a WSI is encoded as a compressed latent representation. These features are placed according to their corresponding patch’s original location in WSI, forming a feature cube. The second part is a classification network fused by 4 famous network blocks with heterogeneous architectures, with feature cube as input. Our model effectively expresses the feature and preserves location information of each patch. The fused network integrates heterogeneous features generated by different networks which yields robust classification results. The model is evaluated on two public datasets with comparison to baseline models. The evaluation results show the effectiveness of the proposed model.Keywords
Funding Information
- Major Science and Technology Projects in Yunnan Province (202102AA100012)
- National Key Research and Development Program of China (2018YFB1802402, 2018YFB1802400)
- National Natural Science Foundation of China (81573827, 81373883)
This publication has 33 references indexed in Scilit:
- Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image featuresNature Communications, 2016
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Validation of digital pathology imaging for primary histopathological diagnosisHistopathology, 2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Going deeper with convolutions2015
- Whole slide imaging in pathology: advantages, limitations, and emerging perspectivesPathology and Laboratory Medicine International, 2015
- The Cancer Genome Atlas Pan-Cancer analysis projectNature Genetics, 2013
- Ensemble Learning2012
- The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of VarianceJournal of the American Statistical Association, 1937