Patch relevance estimation and multilabel augmentation for weakly supervised histopathology image classification
Open Access
- 1 November 2025
- journal article
- Published by SPIE-Intl Soc Optical Eng in Journal of Medical Imaging
- Vol. 12 (06) , 1-21
Abstract
PurposeWeakly supervised learning (WSL) is widely used for histopathological image analysis by modeling images as sets of fixed-size patches and utilizing image-level diagnoses as weak labels. However, in multiclass classification scenarios, patches corresponding to a wide spectrum of diagnostic categories can co-exist in a single image, complicating the learning process. We aim to address label uncertainty in such multiclass settings.ApproachWe propose a two-branch architecture and a complementary training strategy to improve patch-based WSL. One branch estimates patch-level class likelihoods, whereas the other predicts per-class patch relevance weights. These outputs are combined into image-level class predictions via a relevance-weighted sum of per-patch class likelihoods. To further improve performance, we introduce a multilabel augmentation strategy that forms new training samples by combining patch sets and labels from pairs of images, resulting in multilabel samples that enrich the training set by increasing the chance of having more patches that are relevant to the augmented label sets.ResultsWe evaluate our method on two challenging multiclass breast histopathology datasets for region of interest classification. The proposed architecture and training strategy outperform conventional weakly supervised methods, demonstrating improved classification accuracy and robustness, particularly in underrepresented classes.ConclusionsThe proposed architecture effectively models the complex relationship between image-level labels and patch-level content in multiclass histopathological image analysis. Combined with the image-level multilabel augmentation strategy, it improves learning under label uncertainty. These contributions hold potential for more accurate and scalable diagnostic support systems in digital pathology.Keywords
Funding Information
- Türkiye Bilimsel ve Teknolojik Araştırma Kurumu (117E172)
This publication has 14 references indexed in Scilit:
- Deep Feature Representations for Variable-Sized Regions of Interest in Breast HistopathologyIEEE Journal of Biomedical and Health Informatics, 2021
- Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathologyMedical Image Analysis, 2019
- Clinical-grade computational pathology using weakly supervised deep learning on whole slide imagesNature Medicine, 2019
- Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networksPattern Recognition, 2018
- Multi-Instance Multi-Label Learning for Multi-Class Classification of Whole Slide Breast Histopathology ImagesIEEE Transactions on Medical Imaging, 2017
- Region of interest identification and diagnostic agreement in breast pathologyLaboratory Investigation, 2016
- Diagnostic Concordance Among Pathologists Interpreting Breast Biopsy SpecimensJAMA, 2015
- Quantification of histochemical staining by color deconvolution.2001
- Approximate Statistical Tests for Comparing Supervised Classification Learning AlgorithmsNeural Computation, 1998
- Note on the Sampling Error of the Difference Between Correlated Proportions or PercentagesPsychometrika, 1947