LiverNet: efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images
- 30 May 2021
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 16 (9) , 1549-1563
Abstract
Purpose Liver cancer is one of the most common types of cancers in Asia with a high mortality rate. A common method for liver cancer diagnosis is the manual examination of histopathology images. Due to its laborious nature, we focus on alternate deep learning methods for automatic diagnosis, providing significant advantages over manual methods. In this paper, we propose a novel deep learning framework to perform multi-class cancer classification of liver hepatocellular carcinoma (HCC) tumor histopathology images which shows improvements in inference speed and classification quality over other competitive methods. Method The BreastNet architecture proposed by Togacar et al. shows great promise in using convolutional block attention modules (CBAM) for effective cancer classification in H&E stained breast histopathology images. As part of our experiments with this framework, we have studied the addition of atrous spatial pyramid pooling (ASPP) blocks to effectively capture multi-scale features in H&E stained liver histopathology data. We classify liver histopathology data into four classes, namely the non-cancerous class, low sub-type liver HCC tumor, medium sub-type liver HCC tumor, and high sub-type liver HCC tumor. To prove the robustness and efficacy of our models, we have shown results for two liver histopathology datasets—a novel KMC dataset and the TCGA dataset. Results Our proposed architecture outperforms state-of-the-art architectures for multi-class cancer classification of HCC histopathology images, not just in terms of quality of classification, but also in computational efficiency on the novel proposed KMC liver data and the publicly available TCGA-LIHC dataset. We have considered precision, recall, F1-score, intersection over union (IoU), accuracy, number of parameters, and FLOPs as metrics for comparison. The results of our meticulous experiments have shown improved classification performance along with added efficiency. LiverNet has been observed to outperform all other frameworks in all metrics under comparison with an approximate improvement of \(2\%\) in accuracy and F1-score on the KMC and TCGA-LIHC datasets. Conclusion To the best of our knowledge, our work is among the first to provide concrete proof and demonstrate results for a successful deep learning architecture to handle multi-class HCC histopathology image classification among various sub-types of liver HCC tumor. Our method shows a high accuracy of \(90.93\%\) on the proposed KMC liver dataset requiring only 0.5739 million parameters and 1.1934 million floating point operations per second.
Keywords
Funding Information
- This research work was supported in part by the Science Engineering and Research Board, Department of Science and Technology, Govt. of India (Grant No.ECR/2017/000689,2017.)
This publication has 19 references indexed in Scilit:
- Prognostic Analysis of Histopathological Images Using Pre-Trained Convolutional Neural NetworksbioRxiv, 2019
- CBAM: Convolutional Block Attention Module2018
- Microscopic Blood Cell Classification Using Inception Recurrent Residual Convolutional Neural Networks2018
- Classification of Breast Cancer Histology Images Through Transfer Learning Using a Pre-trained Inception Resnet V22018
- MobileNetV2: Inverted Residuals and Linear Bottlenecks2018
- Update in global trends and aetiology of hepatocellular carcinomaContemporary Oncology, 2018
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Image analysis and machine learning in digital pathology: Challenges and opportunitiesMedical Image Analysis, 2016
- Going deeper with convolutions2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition2014