Speeding up reconstruction of 3D tomograms in holographic flow cytometry via deep learning
Open Access
- 19 January 2022
- journal article
- research article
- Published by Royal Society of Chemistry (RSC) in Lab on a Chip
- Vol. 22 (4) , 793-804
Abstract
Tomographic flow cytometry by digital holography is an emerging imaging modality capable of collecting multiple views of moving and rotating cells with the aim of recovering their refractive index distribution in 3D. Although this modality allows us to access high-resolution imaging with high-throughput, the huge amount of time-lapse holographic images to be processed (hundreds of digital holograms per cell) constitutes the actual bottleneck. This prevents the system from being suitable for lab-on-a-chip platforms in real-world applications, where fast analysis of measured data is mandatory. Here we demonstrate a significant speeding-up reconstruction of phase-contrast tomograms by introducing in the processing pipeline a multi-scale fully-convolutional context aggregation network. Although it was originally developed in the context of semantic image analysis, we demonstrate for the first time that it can be successfully adapted to a holographic lab-on-chip platform for achieving 3D tomograms through a faster computational process. We trained the network with input–output image pairs to reproduce the end-to-end holographic reconstruction process, i.e. recovering quantitative phase maps (QPMs) of single cells from their digital holograms. Then, the sequence of QPMs of the same rotating cell is used to perform the tomographic reconstruction. The proposed approach significantly reduces the computational time for retrieving tomograms, thus making them available in a few seconds instead of tens of minutes, while essentially preserving the high-content information of tomographic data. Moreover, we have accomplished a compact deep convolutional neural network parameterization that can fit into on-chip SRAM and a small memory footprint, thus demonstrating its possible exploitation to provide onboard computations for lab-on-chip devices with low processing hardware resources.Keywords
This publication has 58 references indexed in Scilit:
- Flow-scanning optical tomographyLab on a Chip, 2014
- Marker-free phase nanoscopyNature Photonics, 2013
- Digital holographic microscopy quantifies the degree of inflammation in experimental colitisIntegrative Biology, 2013
- Optical imaging techniques for point-of-care diagnosticsLab on a Chip, 2012
- Optical imaging techniques for the study of malariaTrends in Biotechnology, 2012
- Study on aberration suppressing methods in digital micro-holographyOptics and Lasers in Engineering, 2009
- Refractive index maps and membrane dynamics of human red blood cells parasitized by Plasmodium falciparumProceedings of the National Academy of Sciences, 2008
- Optical imaging of cell mass and growth dynamicsAmerican Journal of Physiology-Cell Physiology, 2008
- Investigation of living pancreas tumor cells by digital holographic microscopyJournal of Biomedical Optics, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004