Sketchpose: Learning to Segment Cells with Partial Annotations
Preprint
Abstract
The most popular networks used for cell segmentation (e.g. Cellpose, Stardist, HoverNet,...) rely on a prediction of a distance map. It yields unprecedented accuracy but hinges on fully annotated datasets. This is a serious limitation to generate training sets and perform transfer learning. In this paper, we propose a method that still relies on the distance map and handles partially annotated objects. We evaluate the performance of the proposed approach in the contexts of frugal learning, transfer learning and regular learning on regular databases. Our experiments show that it can lead to substantial savings in time and resources without sacrificing segmentation quality. The proposed algorithm is embedded in a user-friendly Napari plugin.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- CellViT: Vision Transformers for precise cell segmentation and classificationMedical Image Analysis, 2024
- Omnipose: a high-precision morphology-independent solution for bacterial cell segmentationNature Methods, 2022
- napari: a Python Multi-Dimensional Image Viewer Platform for the Research CommunityMicroscopy and Microanalysis, 2022
- A survey on active learning and human-in-the-loop deep learning for medical image analysisMedical Image Analysis, 2021
- Effects of fixation on bacterial cellular dimensions and integrityiScience, 2021
- Cellpose: a generalist algorithm for cellular segmentationNature Methods, 2020
- Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology imagesMedical Image Analysis, 2019
- ilastik: interactive machine learning for (bio)image analysisNature Methods, 2019
- Evaluation of Deep Learning Strategies for Nucleus Segmentation in Fluorescence ImagesCytometry Part A, 2019
- Snakes: Active contour modelsInternational Journal of Computer Vision, 1988