Dense cellular segmentation for EM using 2D–3D neural network ensembles
Authors:
Open Access
- 28 January 2021
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 11 (1) , 1-11
Abstract
Biologists who use electron microscopy (EM) images to build nanoscale 3D models of whole cells and their organelles have historically been limited to small numbers of cells and cellular features due to constraints in imaging and analysis. This has been a major factor limiting insight into the complex variability of cellular environments. Modern EM can produce gigavoxel image volumes containing large numbers of cells, but accurate manual segmentation of image features is slow and limits the creation of cell models. Segmentation algorithms based on convolutional neural networks can process large volumes quickly, but achieving EM task accuracy goals often challenges current techniques. Here, we define dense cellular segmentation as a multiclass semantic segmentation task for modeling cells and large numbers of their organelles, and give an example in human blood platelets. We present an algorithm using novel hybrid 2D–3D segmentation networks to produce dense cellular segmentations with accuracy levels that outperform baseline methods and approach those of human annotators. To our knowledge, this work represents the first published approach to automating the creation of cell models with this level of structural detail.Keywords
All Related Versions
Funding Information
- National Institutes of Health
This publication has 18 references indexed in Scilit:
- VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR imagesNeuroImage, 2018
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field2016
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation2016
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- Deep Residual Learning for Image Recognition2016
- Guest Editorial Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New TechniqueIEEE Transactions on Medical Imaging, 2016
- STEM tomography reveals that the canalicular system and α‐granules remain separate compartments during early secretion stages in blood plateletsJournal of Thrombosis and Haemostasis, 2015
- Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue NanostructurePLOS Biology, 2004