Predicting the HER2 status in oesophageal cancer from tissue microarrays using convolutional neural networks
Authors:
Open Access
- 30 January 2023
- journal article
- research article
- Published by Springer Nature in British Journal of Cancer
- Vol. 128 (7) , 1369-1376
Abstract
Background: Fast and accurate diagnostics are key for personalised medicine. Particularly in cancer, precise diagnosis is a prerequisite for targeted therapies, which can prolong lives. In this work, we focus on the automatic identification of gastroesophageal adenocarcinoma (GEA) patients that qualify for a personalised therapy targeting epidermal growth factor receptor 2 (HER2). We present a deep-learning method for scoring microscopy images of GEA for the presence of HER2 overexpression. Methods: Our method is based on convolutional neural networks (CNNs) trained on a rich dataset of 1602 patient samples and tested on an independent set of 307 patient samples. We additionally verified the CNN’s generalisation capabilities with an independent dataset with 653 samples from a separate clinical centre. We incorporated an attention mechanism in the network architecture to identify the tissue regions, which are important for the prediction outcome. Our solution allows for direct automated detection of HER2 in immunohistochemistry-stained tissue slides without the need for manual assessment and additional costly in situ hybridisation (ISH) tests. Results: We show accuracy of 0.94, precision of 0.97, and recall of 0.95. Importantly, our approach offers accurate predictions in cases that pathologists cannot resolve and that require additional ISH testing. We confirmed our findings in an independent dataset collected in a different clinical centre. The attention-based CNN exploits morphological information in microscopy images and is superior to a predictive model based on the staining intensity only. Conclusions: We demonstrate that our approach not only automates an important diagnostic process for GEA patients but also paves the way for the discovery of new morphological features that were previously unknown for GEA pathology.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (FKZ 01IS20054, FKZ 01ZX1917B)
This publication has 28 references indexed in Scilit:
- Recurrence Risk Stratification After Preoperative Chemoradiation of Esophageal AdenocarcinomaAnnals of Surgery, 2018
- HER2 testing in gastric cancer: results of a German expert meetingJournal of Cancer Research and Clinical Oncology, 2017
- Deep Residual Learning for Image Recognition2016
- Neoadjuvant chemoradiotherapy plus surgery versus surgery alone for oesophageal or junctional cancer (CROSS): long-term results of a randomised controlled trialThe Lancet Oncology, 2015
- Chemoradiation in oesophageal cancerBest Practice & Research Clinical Gastroenterology, 2015
- HER2 positivity in gastric and esophageal adenocarcinoma: clinicopathological analysis and comparisonJournal of Cancer Research and Clinical Oncology, 2014
- Preoperative Chemoradiotherapy for Esophageal or Junctional CancerNew England Journal of Medicine, 2012
- Assessment of ErbB2 (Her2) in oesophageal adenocarcinomas: summary of a revised immunohistochemical evaluation system, bright field double in situ hybridisation and fluorescence in situ hybridisationLaboratory Investigation, 2011
- Quantification of histochemical staining by color deconvolution.2001
- Solving the multiple instance problem with axis-parallel rectanglesArtificial Intelligence, 1997