A deep learning approach for the analysis of birdsong
Open Access
- 18 November 2025
- journal article
- tools and-resources
- Published by eLife Sciences Publications, Ltd in eLife
- Vol. 13
Abstract
Deep learning tools for behavior analysis have enabled important insights and discoveries in neuroscience. Yet, they often compromise interpretability and generalizability for performance, making quantitative comparisons across datasets difficult. We developed a novel deep learning-based behavior analysis pipeline, Avian Vocalization Network (AVN), for zebra finch learned vocalizations - the most widely studied vocal learning model species. AVN annotates songs with high accuracy, generalizing across multiple animal colonies without re-training, and generates a comprehensive set of interpretable features describing song syntax, timing, and acoustic properties. We use this feature set to compare song phenotypes across research groups and experiments and to predict a bird’s stage in song development. Additionally, we have developed a novel method to measure song imitation that requires no training data for new comparisons and outperforms existing similarity scoring methods in its sensitivity and agreement with expert human judgements. These tools are available through the open-source AVN python package and graphical application, making them accessible to researchers without prior coding experience. Altogether, this behavior analysis toolkit stands to accelerate the study of vocal behavior by standardizing phenotype and learning outcome mapping, thus helping scientists better link behavior to the underlying neural processes.Keywords
All Related Versions
Funding Information
- National Institutes of Health (R01 DC020333)
- University of Texas Southwestern Medical Center (Neural Scientist Training Program)
- University of Texas at Dallas (UTSW Green Fellow's Program)
This publication has 40 references indexed in Scilit:
- RETRACTED ARTICLE: The hidden fitness of the male zebra finch courtship songNature, 2024
- Zebra finches (Taeniopygia guttata) demonstrate cognitive flexibility in using phonology and sequence of syllables in auditory discriminationAnimal Cognition, 2023
- B-SOiD, an open-source unsupervised algorithm for identification and fast prediction of behaviorsNature Communications, 2021
- Expression of FoxP2 in the basal ganglia regulates vocal motor sequences in the adult songbirdNature Communications, 2021
- Balanced imitation sustains song culture in zebra finchesNature Communications, 2021
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- Regularities in zebra finch song beyond the repeated motifBehavioural Processes, 2019
- DeepSqueak: a deep learning-based system for detection and analysis of ultrasonic vocalizationsNeuropsychopharmacology, 2019
- Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsongNature, 2007
- A procedure for an automated measurement of song similarityAnimal Behaviour, 2000