Deep Learning-Meets-Active Surfaces: A Unified Framework for Multi-Object Segmentation and Shape Analysis in 3D Fluorescence Microscopy
Preprint
Abstract
In this paper, we introduce Nagini3D, a 3D biological image segmentation method that hybridizes two high-performing yet highly complementary segmentation paradigms: deep learning-based approaches and snake-based methods. Our approach leverages both the high efficiency of data-driven techniques and the convenient shape representation provided by active surfaces, which proves highly practical for incorporating a priori knowledge as well as for the post-analysis of segmented objects. By considering a complete 3D volume, our method ensures segmentation consistency across all three dimensions, unlike many approaches that handle volumes in a slice-by-slice manner. Additionally, it theoretically enables the representation of any object with spherical topology, overcoming the limitations of common 3D methods that rely on object convexity assumptions. Furthermore, the continuous representation of objects allows for a resolution-independent description, facilitating the extraction of various geometric features of interest (e.g., local curvature, principal deformations). We demonstrate both the quality of the segmentation produced by our method and the richness of the accessible geometric features through an extensive set of experiments conducted on multiple real and simulated datasets, including objects with challenging geometries.Keywords
This publication has 43 references indexed in Scilit:
- A Learning-Based Formulation of Parametric Curve Fitting for Bioimage Analysis2021
- Cell Detection with Star-Convex Polygons2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Stochastic Geometry for Image Analysis2013
- Geodesic Methods for Shape and Surface Processing2008
- Space and Time Shape Constrained Deformable Surfaces for 4D Medical Image Segmentation2000
- A Hierarchical Markov Modeling Approach for the Segmentation and Tracking of Deformable ShapesGraphical Models and Image Processing, 1998
- Active Shape Models-Their Training and ApplicationComputer Vision and Image Understanding, 1995
- Feature extraction from faces using deformable templatesInternational Journal of Computer Vision, 1992
- Snakes: Active contour modelsInternational Journal of Computer Vision, 1988