Fast Segmentation of Metastatic Foci in H&E Whole-Slide Images for Breast Cancer Diagnosis
Open Access
- 14 April 2022
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 12 (4) , 990
Abstract
Breast cancer is the leading cause of death for women globally. In clinical practice, pathologists visually scan over enormous amounts of gigapixel microscopic tissue slide images, which is a tedious and challenging task. In breast cancer diagnosis, micro-metastases and especially isolated tumor cells are extremely difficult to detect and are easily neglected because tiny metastatic foci might be missed in visual examinations by medical doctors. However, the literature poorly explores the detection of isolated tumor cells, which could be recognized as a viable marker to determine the prognosis for T1NoMo breast cancer patients. To address these issues, we present a deep learning-based framework for efficient and robust lymph node metastasis segmentation in routinely used histopathological hematoxylin–eosin-stained (H–E) whole-slide images (WSI) in minutes, and a quantitative evaluation is conducted using 188 WSIs, containing 94 pairs of H–E-stained WSIs and immunohistochemical CK(AE1/AE3)-stained WSIs, which are used to produce a reliable and objective reference standard. The quantitative results demonstrate that the proposed method achieves 89.6% precision, 83.8% recall, 84.4% F1-score, and 74.9% mIoU, and that it performs significantly better than eight deep learning approaches, including two recently published models (v3_DCNN and Xception-65), and three variants of Deeplabv3+ with three different backbones, namely, U-Net, SegNet, and FCN, in precision, recall, F1-score, and mIoU (). Importantly, the proposed system is shown to be capable of identifying tiny metastatic foci in challenging cases, for which there are high probabilities of misdiagnosis in visual inspection, while the baseline approaches tend to fail in detecting tiny metastatic foci. For computational time comparison, the proposed method takes 2.4 min for processing a WSI utilizing four NVIDIA Geforce GTX 1080Ti GPU cards and 9.6 min using a single NVIDIA Geforce GTX 1080Ti GPU card, and is notably faster than the baseline methods (4-times faster than U-Net and SegNet, 5-times faster than FCN, 2-times faster than the 3 different variants of Deeplabv3+, 1.4-times faster than v3_DCNN, and 41-times faster than Xception-65).
Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (MOST 108-2221-E-011-070 and 109-2221-E-011-018-MY3)
This publication has 39 references indexed in Scilit:
- Rapid diagnosis of lymph node metastasis in breast cancer using a new fluorescent method with γ-glutamyl hydroxymethyl rhodamine greenScientific Reports, 2016
- Fully Convolutional Networks for Semantic SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Automated Detection of DCIS in Whole-Slide H&E Stained Breast Histopathology ImagesIEEE Transactions on Medical Imaging, 2016
- Sentinel Lymph Node in Breast Cancer: Review Article from a Pathologist’s Point of ViewJournal of Pathology and Translational Medicine, 2016
- Deep learningNature, 2015
- Domain Adaptation for Microscopy ImagingIEEE Transactions on Medical Imaging, 2014
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Optimisation of breast cancer management in low-resource and middle-resource countries: executive summary of the Breast Health Global Initiative consensus, 2010The Lancet Oncology, 2011
- The American Joint Committee on Cancer: the 7th Edition of the AJCC Cancer Staging Manual and the Future of TNMAnnals of Surgical Oncology, 2010
- Prognostic implication of isolated tumor cells and micrometastases in regional lymph nodes of gastric cancerWorld Journal of Gastroenterology, 2005