Community-based benchmarking improves spike rate inference from two-photon calcium imaging data
Jakob H. Macke,
Kenneth D. Harris,
Timothy A. Machado,
Dario L. Ringach,
Luke E. Rogerson,
Nicolas J. Sofroniew,
Miroslav Román Rosón,
Posted 18 Aug 2017
bioRxiv DOI: 10.1101/177956 (published DOI: 10.1371/journal.pcbi.1006157)
Posted 18 Aug 2017
In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike trains from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.
- Downloaded 1,678 times
- Download rankings, all-time:
- Site-wide: 4,550 out of 84,436
- In neuroscience: 683 out of 15,010
- Year to date:
- Site-wide: 26,353 out of 84,436
- Since beginning of last month:
- Site-wide: 22,458 out of 84,436
Downloads over time
Distribution of downloads per paper, site-wide
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!