Generative Adversarial Domain Adaptation for Nucleus Quantification in Images of Tissue Immunohistochemically Stained for Ki-67
Open Access
- 1 November 2020
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 4 (4) , 666-679
Abstract
PURPOSE: We focus on the problem of scarcity of annotated training data for nucleus recognition in Ki-67 immunohistochemistry (IHC)–stained pancreatic neuroendocrine tumor (NET) images. We hypothesize that deep learning–based domain adaptation is helpful for nucleus recognition when image annotations are unavailable in target data sets. METHODS: We considered 2 different institutional pancreatic NET data sets: one (ie, source) containing 38 cases with 114 annotated images and the other (ie, target) containing 72 cases with 20 annotated images. The gold standards were manually annotated by 1 pathologist. We developed a novel deep learning–based domain adaptation framework to count different types of nuclei (ie, immunopositive tumor, immunonegative tumor, nontumor nuclei). We compared the proposed method with several recent fully supervised deep learning models, such as fully convolutional network-8s (FCN-8s), U-Net, fully convolutional regression network (FCRN) A, FCRNB, and fully residual convolutional network (FRCN). We also evaluated the proposed method by learning with a mixture of converted source images and real target annotations. RESULTS: Our method achieved an F1 score of 81.3% and 62.3% for nucleus detection and classification in the target data set, respectively. Our method outperformed FCN-8s (53.6% and 43.6% for nucleus detection and classification, respectively), U-Net (61.1% and 47.6%), FCRNA (63.4% and 55.8%), and FCRNB (68.2% and 60.6%) in terms of F1 score and was competitive with FRCN (81.7% and 70.7%). In addition, learning with a mixture of converted source images and only a small set of real target labels could further boost the performance. CONCLUSION: This study demonstrates that deep learning–based domain adaptation is helpful for nucleus recognition in Ki-67 IHC stained images when target data annotations are not available. It would improve the applicability of deep learning models designed for downstream supervised learning tasks on different data sets.Keywords
This publication has 38 references indexed in Scilit:
- An international study to increase concordance in Ki67 scoringLaboratory Investigation, 2015
- Deep learningNature, 2015
- Calculation of the Ki67 index in pancreatic neuroendocrine tumors: a comparative analysis of four counting methodologiesLaboratory Investigation, 2014
- Automatic Ki-67 Counting Using Robust Cell Detection and Online Dictionary LearningIEEE Transactions on Biomedical Engineering, 2013
- Ki-67 is a reliable pathological grading marker for neuroendocrine tumorsVirchows Archiv, 2013
- Machine learning in cell biology – teaching computers to recognize phenotypesJournal of Cell Science, 2013
- TNM staging of foregut (neuro)endocrine tumors: a consensus proposal including a grading systemVirchows Archiv, 2006
- A 5‐decade analysis of 13,715 carcinoid tumorsCancer, 2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955