Registering large volume serial-section electron microscopy image sets for neural circuit reconstruction using FFT signal whitening
Authors:
- 1 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-10
Abstract
The detailed reconstruction of neural anatomy for connectomics studies requires a combination of resolution and large three-dimensional data capture provided by serial section electron microscopy (ssEM). The convergence of high throughput ssEM imaging and improved tissue preparation methods now allows ssEM capture of complete specimen volumes up to cubic millimeter scale. The resulting multi-terabyte image sets span thousands of serial sections and must be precisely registered into coherent volumetric forms in which neural circuits can be traced and segmented. This paper introduces a Signal Whitening Fourier Transform Image Registration approach (SWiFT-IR) under development at the Pittsburgh Supercomputing Center and its use to align mouse and zebrafish brain datasets acquired using the wafer mapper ssEM imaging technology recently developed at Harvard University. Unlike other methods now used for ssEM registration, SWiFT-IR modifies its spatial frequency response during image matching to maximize a signal-to-noise measure used as its primary indicator of alignment quality. This alignment signal is more robust to rapid variations in biological content and unavoidable data distortions than either phase-only or standard Pearson correlation, thus allowing more precise alignment and statistical confidence. These improvements in turn enable an iterative registration procedure based on projections through multiple sections rather than more typical adjacent-pair matching methods. This projection approach, when coupled with known anatomical constraints and iteratively applied in a multi-resolution pyramid fashion, drives the alignment into a smooth form that properly represents complex and widely varying anatomical content such as the full cross-section zebrafish data.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Anatomy and function of an excitatory network in the visual cortexNature, 2016
- Network anatomy and in vivo physiology of visual cortical neuronsNature, 2011
- As-rigid-as-possible mosaicking and serial section registration of large ssTEM datasetsBioinformatics, 2010
- A high-level 3D visualization API for Java and ImageJBMC Bioinformatics, 2010
- elastix: A Toolbox for Intensity-Based Medical Image RegistrationIEEE Transactions on Medical Imaging, 2009
- Optical Encoding of 3D Correlation for Color Pattern Recognition2004
- Optimum nonlinear composite filter for distortion-tolerant pattern recognitionApplied Optics, 2002
- Nonlinear joint transform correlatorsPattern Recognition, 1994
- Principal warps: thin-plate splines and the decomposition of deformationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989
- Random sample consensusCommunications of the ACM, 1981