Cell Segmentation Beyond 2D—A Review of the State‐of‐the‐Art
Open Access
- 7 April 2026
- journal article
- review article
- Published by Wiley in Advanced Intelligent Discovery
Abstract
Cell segmentation is a cornerstone of biological image analysis, enabling downstream applications such as tracking, counting, and phenotypic profiling. Deep learning has markedly improved segmentation accuracy, leading to broad adoption in research and clinical workflows. However, most current approaches operate on 2D images, neglecting spatial information in the third dimension. This omission is critical, as cellular morphology, migration, and division are inherently three‐dimensional processes. Modern microscopy now offers high‐throughput volumetric imaging, presenting new opportunities for methods that fully exploit 3D data. This review surveys segmentation strategies that incorporate depth information, extending beyond conventional 2D analysis. It distinguishes between pseudo‐3D (2.5D) methods, which balance computational efficiency with limited volumetric context, and fully 3D methods that process volumetric input and output directly. In total, 31 beyond‐2D segmentation approaches are examined and compared, alongside 32 curated volumetric datasets annotated with key metadata such as resolution, size, and ground‐truth availability. Furthermore, a unified reference dataset, compiled from high‐quality open‐source resources, is presented to promote standardized data access, metadata harmonization, and future community‐driven benchmarking efforts in 3D cell segmentation.Keywords
This publication has 76 references indexed in Scilit:
- A 2.5D multi-path fusion network framework with focusing on z-axis 3D joint for medical image segmentationBiomedical Signal Processing and Control, 2024
- Instance segmentation of mitochondria in electron microscopy images with a generalist deep learning model trained on a diverse datasetCell Systems, 2023
- Systematic Review of Generative Adversarial Networks (GANs) for Medical Image Classification and SegmentationJournal of Digital Imaging, 2022
- VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning2021
- Confocal Microscopy: Principles and Modern PracticesCurrent Protocols in Cytometry, 2019
- Deep Learning Based Instance Segmentation in 3D Biomedical Images Using Weak Annotation2018
- Stacked Hourglass Networks for Human Pose Estimation2016
- Multi-Scale Modeling of Tissues Using CompuCell3D2012
- Topographic distance and watershed linesSignal Processing, 1994
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955