Plug-and-Play automated behavioral tracking of zebrafish larvae with DeepLabCut and SLEAP: pre-trained networks and datasets of annotated poses
Preprint
Abstract
Zebrafish are an important model system in behavioral neuroscience due to their rapid development and suite of distinct, innate behaviors. Quantifying many of these larval behaviors requires detailed tracking of eye and tail kinematics, which in turn demands imaging at high spatial and temporal resolution, ideally using semi or fully automated tracking methods for throughput efficiency. However, creating and validating accurate tracking models is time-consuming and labor intensive, with many research groups duplicating efforts on similar images. With the goal of developing a useful community resource, we trained pose estimation models using a diverse array of video parameters and a 15-keypoint pose model. We deliver an annotated dataset of free-swimming and head-embedded behavioral videos of larval zebrafish, along with four pose estimation networks from DeepLabCut and SLEAP (two variants of each). We also evaluated model performance across varying imaging conditions to guide users in optimizing their imaging setups. This resource will allow other researchers to skip the tedious and laborious training steps for setting up behavioral analyses, guide model selection for specific research needs, and provide ground truth data for benchmarking new tracking methods. SIGNIFICANCE STATEMENT Larval zebrafish are an emerging model in systems neuroscience, offering unique advantages for linking brain activity to behavior. However, detailed behavioral tracking, essential for such studies, requires time- and labor-intensive annotation and model training. To eliminate this bottleneck, here we provide a high-quality, annotated dataset of zebrafish behaviors for both free-swimming and head-embedded preparations alongside four pre-trained pose estimation models using DeepLabCut and SLEAP. We benchmark models’ performance across diverse imaging conditions to guide optimal setup choices. This community resource will allow researchers to bypass the most time-consuming stages of data annotation and training, enabling immediate behavioral analysis. By removing this key hurdle, this work will accelerate project initiation, support reproducibility, and provide a foundation for future tracking method development.Keywords
Funding Information
- Australian Research Council (DE220100691)
- Australian Research Council (DP220103812)
- Australian Research Council (DP230102614)
- National Institutes of Health (R01NS118406)
This publication has 36 references indexed in Scilit:
- SuperAnimal pretrained pose estimation models for behavioral analysisNature Communications, 2024
- Learnable latent embeddings for joint behavioural and neural analysisNature, 2023
- High-throughput functional analysis of autism genes in zebrafish identifies convergence in dopaminergic and neuroimmune pathwaysCell Reports, 2023
- SLEAP: A deep learning system for multi-animal pose trackingNature Methods, 2022
- Probabilistic Models of Larval Zebrafish Behavior Reveal Structure on Many ScalesCurrent Biology, 2020
- Deconstructing Hunting Behavior Reveals a Tightly Coupled Stimulus-Response LoopCurrent Biology, 2020
- idtracker.ai: tracking all individuals in small or large collectives of unmarked animalsNature Methods, 2019
- Fast animal pose estimation using deep neural networksNature Methods, 2018
- Structure of the Zebrafish Locomotor Repertoire Revealed with Unsupervised Behavioral ClusteringCurrent Biology, 2018
- Visual Threat Assessment and Reticulospinal Encoding of Calibrated Responses in Larval ZebrafishCurrent Biology, 2017