Community-based benchmarking improves spike rate inference from two-photon calcium imaging data
Authors:
- Philipp BerensPBPhilipp Berens
- Jeremy FreemanJFJeremy Freeman
- Thomas DeneuxTDThomas Deneux
- Nicolay ChenkovNCNicolay Chenkov
- Thomas McColganTMThomas McColgan
- Artur SpeiserASArtur Speiser
- Jakob H. MackeJMJakob H. Macke
- Srinivas TuragaSTSrinivas Turaga
- Patrick MineaultPMPatrick Mineault
- Peter RupprechtPRPeter Rupprecht
- Stephan GerhardSGStephan Gerhard
- Rainer W. FriedrichRFRainer W. Friedrich
Open Access
- 18 August 2017
- other
- Published by openRxiv
- p. 177956
Abstract
In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike trains from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.Keywords
This publication has 23 references indexed in Scilit:
- Saliency Benchmarking Made Easy: Separating Models, Maps and Metrics2018
- Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivoNature Communications, 2016
- Benchmarking Spike Rate Inference in Population Calcium ImagingNeuron, 2016
- Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging DataNeuron, 2016
- Open source tools for large-scale neuroscienceCurrent Opinion in Neurobiology, 2015
- Comprehensive imaging of cortical networksCurrent Opinion in Neurobiology, 2015
- Ultrasensitive fluorescent proteins for imaging neuronal activityNature, 2013
- Photon Shot Noise Limits on Optical Detection of Neuronal Spikes and Estimation of Spike TimingBiophysical Journal, 2013
- High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precisionNature Methods, 2010
- Spike Inference from Calcium Imaging Using Sequential Monte Carlo MethodsBiophysical Journal, 2009