Fourier Transform Multiple Instance Learning for whole slide image classification
- 22 October 2025
- journal article
- research article
- Published by SPIE-Intl Soc Optical Eng in Journal of Medical Imaging
- Vol. 12 (06) , 1-21
Abstract
PurposeWhole slide image (WSI) classification relies on multiple instance learning (MIL) with spatial patch features, but current methods struggle to capture global dependencies due to the immense size of WSIs and the local nature of patch embeddings. This limitation hinders the modeling of coarse structures essential for robust diagnostic prediction.ApproachWe propose Fourier Transform Multiple Instance Learning (FFT-MIL), a framework that augments MIL with a frequency-domain branch to provide compact global context. Low-frequency crops are extracted from WSIs via the Fast Fourier Transform and processed through a modular FFT-Block composed of convolutional layers and Min-Max normalization to mitigate the high variance of frequency data. The learned global frequency feature is fused with spatial patch features through lightweight integration strategies, enabling compatibility with diverse MIL architectures.ResultsFFT-MIL was evaluated across six state-of-the-art MIL methods on three public datasets (BRACS, LUAD, and IMP). Integration of the FFT-Block improved macro F1 scores by an average of 3.51% and area under the curve by 1.51%, demonstrating consistent gains across architectures and datasets.ConclusionsFFT-MIL establishes frequency-domain learning as an effective and efficient mechanism for capturing global dependencies in WSI classification, complementing spatial features and advancing the scalability and accuracy of MIL-based computational pathology. The source code is publicly available at https://github.com/irulenot/FFT-MIL.Keywords
All Related Versions
Funding Information
- University of Central Florida
This publication has 13 references indexed in Scilit:
- An interpretable machine learning system for colorectal cancer diagnosis from pathology slidesnpj Precision Oncology, 2024
- Cross-scale multi-instance learning for pathological image diagnosisMedical Image Analysis, 2024
- Computational pathology: A survey review and the way forwardJournal of Pathology Informatics, 2024
- Multiple instance learning for digital pathology: A review of the state-of-the-art, limitations & future potentialComputerized Medical Imaging and Graphics, 2024
- BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology ImagesDatabase: The Journal of Biological Databases and Curation, 2022
- Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive LearningIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021
- Data-efficient and weakly supervised computational pathology on whole-slide imagesNature Biomedical Engineering, 2021
- Proteogenomic Characterization Reveals Therapeutic Vulnerabilities in Lung AdenocarcinomaCell, 2020
- Occlusions contribute to scaling in natural imagesVision Research, 2001
- Statistics of natural images: Scaling in the woodsPhysical Review Letters, 1994