Aggregation Model Hyperparameters Matter in Digital Pathology
Authors:
Preprint
Abstract
Digital pathology has significantly advanced disease detection and pathologist efficiency through the analysis of gigapixel whole-slide images (WSI). In this process, WSIs are first divided into patches, for which a feature extractor model is applied to obtain feature vectors, which are subsequently processed by an aggregation model to predict the respective WSI label. With the rapid evolution of representation learning, numerous new feature extractor models, often termed foundational models, have emerged. Traditional evaluation methods, however, rely on fixed aggregation model hyperparameters, a framework we identify as potentially biasing the results. Our study uncovers a co-dependence between feature extractor models and aggregation model hyperparameters, indicating that performance comparability can be skewed based on the chosen hyperparameters. By accounting for this co-dependency, we find that the performance of many current feature extractor models is notably similar. We support this insight by evaluating seven feature extractor models across three different datasets with 162 different aggregation model configurations. This comprehensive approach provides a more nuanced understanding of the relationship between feature extractors and aggregation models, leading to a fairer and more accurate assessment of feature extractor models in digital pathology.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Multiple instance learning for digital pathology: A review of the state-of-the-art, limitations & future potentialComputerized Medical Imaging and Graphics, 2024
- Robust and data-efficient generalization of self-supervised machine learning for diagnostic imagingNature Biomedical Engineering, 2023
- HEROHE Challenge: Predicting HER2 Status in Breast Cancer from Hematoxylin–Eosin Whole-Slide ImagingJournal of Imaging, 2022
- Transformer-based unsupervised contrastive learning for histopathological image classificationMedical Image Analysis, 2022
- An Empirical Study of Training Self-Supervised Vision Transformers2021
- Review The Cancer Genome Atlas (TCGA): an immeasurable source of knowledgeContemporary Oncology, 2015