Multi-Modality Microscopy Image Style Augmentation for Nuclei Segmentation
Open Access
- 11 March 2022
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 8 (3) , 71
Abstract
Annotating microscopy images for nuclei segmentation by medical experts is laborious and time-consuming. To leverage the few existing annotations, also across multiple modalities, we propose a novel microscopy-style augmentation technique based on a generative adversarial network (GAN). Unlike other style transfer methods, it can not only deal with different cell assay types and lighting conditions, but also with different imaging modalities, such as bright-field and fluorescence microscopy. Using disentangled representations for content and style, we can preserve the structure of the original image while altering its style during augmentation. We evaluate our data augmentation on the 2018 Data Science Bowl dataset consisting of various cell assays, lighting conditions, and imaging modalities. With our style augmentation, the segmentation accuracy of the two top-ranked Mask R-CNN-based nuclei segmentation algorithms in the competition increases significantly. Thus, our augmentation technique renders the downstream task more robust to the test data heterogeneity and helps counteract class imbalance without resampling of minority classes.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Nucleus segmentation across imaging experiments: the 2018 Data Science BowlNature Methods, 2019
- Deep learning for cellular image analysisNature Methods, 2019
- Diverse Image-to-Image Translation via Disentangled Representations2018
- Tumor-Aware, Adversarial Domain Adaptation from CT to MRI for Lung Cancer Segmentation2018
- Learning Uncertain Convolutional Features for Accurate Saliency Detection2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- Feature Pyramid Networks for Object Detection2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Lens-Free Imaging for Biological ApplicationsSLAS Technology, 2012
- Histopathological Image Analysis: A ReviewIEEE Reviews in Biomedical Engineering, 2009