Anja T. Zai
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Anja T. Zai has a total of 43 co-authors. Here are the top co-authors by number of shared publications:
- Richard H. R. Hahnloser
Institute of Neuroinformatics, University of Zürich and ETH Zürich, Zürich, Switzerland
19 shared publications - Nicolas Giret
Institut des Neurosciences Paris-Saclay, CNRS & Université Paris-Saclay, Saclay, France
9 shared publications - Anna E. Stepien
Neuroscience Center Zurich (ZNZ), University of Zurich and ETH Zurich
4 shared publications Sophie Cavé-Lopez
Institute of Neuroinformatics, University of Zürich and ETH Zürich
3 shared publicationsAlessandro Canopoli
ETH Zurich, Institute of Neuroinformatics
2 shared publicationsAnna E. Stepien
Affiliations Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland, Neuroscience Center Zurich (ZNZ), University of Zurich and ETH Zurich, Zurich, Switzerland
2 shared publications
Latest Publications
- Open Access
- 13 January 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (2) , 810
Benchmarking Automated and Semi-Automated Vocal Clustering Methods
Analyzing large datasets of animal vocalizations requires efficient bioacoustic methods for categorizing the vocalization types. This study evaluates the effectiveness of different vocalization clustering methods, comparing fully automated and semi-automated methods against the gold standard of manual expert annotations. Effective methods achieve good clustering performance whilst minimizing human effort. We release a new dataset of 1454 zebra finch vocalizations manually clustered by experts, on which we evaluate (i) fully automated clustering using off-the-shelf methods based on sound embeddings and (ii) a semi-automated workflow relying on refining the embedding-derived clusters. Clustering performance is assessed using the Adjusted Rand Index (ARI) and Normalized Mutual Information (NMI). Results indicate that while fully automated methods provide a useful baseline, they generally fall short of human-level consistency. In contrast, the semi-automated workflow achieved agreement scores comparable to inter-expert reliability, approaching the levels of expert manual clustering. This demonstrates that refining embedding-derived clusters reduces annotation time while maintaining gold standard accuracy. We conclude that semi-automated workflows offer an optimal strategy for bioacoustics, enabling the scalable analysis of large datasets without compromising the precision required for robust behavioral insights.
- 13 January 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (2) , 810
Open AccessBenchmarking Automated and Semi-Automated Vocal Clustering Methods
Analyzing large datasets of animal vocalizations requires efficient bioacoustic methods for categorizing the vocalization types. This study evaluates the effectiveness of different vocalization clustering methods, comparing fully automated and semi-automated methods against the gold standard of manual expert annotations. Effective methods achieve good clustering performance whilst minimizing human effort. We release a new dataset of 1454 zebra finch vocalizations manually clustered by experts, on which we evaluate (i) fully automated clustering using off-the-shelf methods based on sound embeddings and (ii) a semi-automated workflow relying on refining the embedding-derived clusters. Clustering performance is assessed using the Adjusted Rand Index (ARI) and Normalized Mutual Information (NMI). Results indicate that while fully automated methods provide a useful baseline, they generally fall short of human-level consistency. In contrast, the semi-automated workflow achieved agreement scores comparable to inter-expert reliability, approaching the levels of expert manual clustering. This demonstrates that refining embedding-derived clusters reduces annotation time while maintaining gold standard accuracy. We conclude that semi-automated workflows offer an optimal strategy for bioacoustics, enabling the scalable analysis of large datasets without compromising the precision required for robust behavioral insights.
- Open Access
Vib2Sound: Separation of Multimodal Sound Sources
Understanding animal social behaviors, including vocal communication, requires longitudinal observation of interacting individuals. However, isolating individual-level vocalizations in complex environments is challenging due to background noise and frequent overlaps of coincident signals from multiple vocalizers. A promising solution lies in multimodal recordings that combine traditional microphones with animal-borne sensors, such as accelerometers and directional microphones. These sensors, however, are constrained by strict limits on weight, size, and power consumption and often lead to noisy or unstable signals. In this work, we introduce a neural network-based system for sound source separation which leverages multi-channel microphone recordings and body-mounted accelerometer signals. Using a dataset of zebra finches recorded in a social setting, we demonstrate that contact sensing largely outperforms conventional microphone-array recordings. By enabling the separation of overlapping vocalizations, our approach offers a valuable tool for studying animal communication in complex naturalistic environments.
Open AccessVib2Sound: Separation of Multimodal Sound Sources
Understanding animal social behaviors, including vocal communication, requires longitudinal observation of interacting individuals. However, isolating individual-level vocalizations in complex environments is challenging due to background noise and frequent overlaps of coincident signals from multiple vocalizers. A promising solution lies in multimodal recordings that combine traditional microphones with animal-borne sensors, such as accelerometers and directional microphones. These sensors, however, are constrained by strict limits on weight, size, and power consumption and often lead to noisy or unstable signals. In this work, we introduce a neural network-based system for sound source separation which leverages multi-channel microphone recordings and body-mounted accelerometer signals. Using a dataset of zebra finches recorded in a social setting, we demonstrate that contact sensing largely outperforms conventional microphone-array recordings. By enabling the separation of overlapping vocalizations, our approach offers a valuable tool for studying animal communication in complex naturalistic environments.
- Open Access
- 26 February 2025
- Published by The Royal Society in Philosophical Transactions of the Royal Society B: Biological Sciences
- Vol. 380 (1920) , 20230430
A synchrotron X-ray CT-based 3D atlas of the songbird syrinx with single muscle fibre resolution implies fine motor control of syringeal vocal folds
Avian vocalizations are produced by precisely coordinated motion of the respiratory, syringeal and upper vocal tract systems. Syringeal muscles are controlled with unprecedented resolution, down to independent control of individual muscle fibres. However, we currently lack an anatomical description of syrinx muscles at single fibre resolution. Here, we combined a micron-resolution synchrotron X-ray CT scan of the zebra finch syrinx with micro-dissections of independent specimens to resolve syrinx muscle morphology at individual muscle fibre level. We define two new, previously unknown muscles and update the fibre trajectories and attachment sites of three previously described muscles. Our new insights into the fine anatomy of syrinx muscles show that not one, but both avian vocal folds can be directly controlled by contracting syrinx muscles. Thus, our data reveal novel anatomical complexity with consequences for the biomechanics and motor control of sound production. This article is part of the theme issue ‘The biology of the avian respiratory system’.
- 26 February 2025
- Published by The Royal Society in Philosophical Transactions of the Royal Society B: Biological Sciences
- Vol. 380 (1920) , 20230430
Open AccessA synchrotron X-ray CT-based 3D atlas of the songbird syrinx with single muscle fibre resolution implies fine motor control of syringeal vocal folds
Avian vocalizations are produced by precisely coordinated motion of the respiratory, syringeal and upper vocal tract systems. Syringeal muscles are controlled with unprecedented resolution, down to independent control of individual muscle fibres. However, we currently lack an anatomical description of syrinx muscles at single fibre resolution. Here, we combined a micron-resolution synchrotron X-ray CT scan of the zebra finch syrinx with micro-dissections of independent specimens to resolve syrinx muscle morphology at individual muscle fibre level. We define two new, previously unknown muscles and update the fibre trajectories and attachment sites of three previously described muscles. Our new insights into the fine anatomy of syrinx muscles show that not one, but both avian vocal folds can be directly controlled by contracting syrinx muscles. Thus, our data reveal novel anatomical complexity with consequences for the biomechanics and motor control of sound production. This article is part of the theme issue ‘The biology of the avian respiratory system’.
- Open Access
Estimating the motor exploration in reinforcement learning
What motor exploration strategies do animals use to learn a skill from rewards? Reinforcement learning theory provides no guidance for estimating motor exploration — the behavioral component aimed at discovering better strategies. Inspired by the brain’s modular organization, we postulate a latent learner that explores via an additive source of ideal randomness it injects into behavior. Assuming the learner is ignorant of other motor components, which is sub-optimal by design, evolutionary fitness argues that these should display mainly non-ideal variability. We test this recipe for behavior decomposition in songbirds subjected to a vocal pitch conditioning task. The explorative component we estimate from vocalizations accounts for the motor contribution of a basal ganglia pathway and the other behavioral component accounts for birds’ suboptimal learning trajectories. This congruence between normative exploration and brain organization suggests that the evolutionary pressure for behavioral optimality is lesser than to learn from purely random trials.
Open AccessEstimating the motor exploration in reinforcement learning
What motor exploration strategies do animals use to learn a skill from rewards? Reinforcement learning theory provides no guidance for estimating motor exploration — the behavioral component aimed at discovering better strategies. Inspired by the brain’s modular organization, we postulate a latent learner that explores via an additive source of ideal randomness it injects into behavior. Assuming the learner is ignorant of other motor components, which is sub-optimal by design, evolutionary fitness argues that these should display mainly non-ideal variability. We test this recipe for behavior decomposition in songbirds subjected to a vocal pitch conditioning task. The explorative component we estimate from vocalizations accounts for the motor contribution of a basal ganglia pathway and the other behavioral component accounts for birds’ suboptimal learning trajectories. This congruence between normative exploration and brain organization suggests that the evolutionary pressure for behavioral optimality is lesser than to learn from purely random trials.
- Open Access
- 9 January 2025
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 20 (1) , e0307126
Familiarity of an environment prevents song suppression in isolated zebra finches
Despite the wide use of zebra finches as an animal model to study vocal learning and production, little is known about impacts on their welfare caused by routine experimental manipulations such as changing their social context. Here we conduct a post-hoc analysis of singing rate, an indicator of positive welfare, to gain insights into stress caused by social isolation, a common experimental manipulation. We find that isolation in an unfamiliar environment reduces singing rate for several days, indicating the presence of an acute stressor. However, we find no such decrease when social isolation is caused by either removal of a social companion or by transfer to a familiar environment. Furthermore, during repeated brief periods of isolation, singing rate remains high when isolation is induced by removal of social companions, but it fails to recover from a suppressed state when isolation is induced by recurrent transfer to an unknown environment. These findings suggest that stress from social isolation is negligible compared to stress caused by environmental changes and that frequent short visits of an unfamiliar environment are detrimental rather than beneficial. Together, these insights can serve to refine experimental studies and design paradigms maximizing the birds’ wellbeing and vocal output.
- 9 January 2025
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 20 (1) , e0307126
Open AccessFamiliarity of an environment prevents song suppression in isolated zebra finches
Despite the wide use of zebra finches as an animal model to study vocal learning and production, little is known about impacts on their welfare caused by routine experimental manipulations such as changing their social context. Here we conduct a post-hoc analysis of singing rate, an indicator of positive welfare, to gain insights into stress caused by social isolation, a common experimental manipulation. We find that isolation in an unfamiliar environment reduces singing rate for several days, indicating the presence of an acute stressor. However, we find no such decrease when social isolation is caused by either removal of a social companion or by transfer to a familiar environment. Furthermore, during repeated brief periods of isolation, singing rate remains high when isolation is induced by removal of social companions, but it fails to recover from a suppressed state when isolation is induced by recurrent transfer to an unknown environment. These findings suggest that stress from social isolation is negligible compared to stress caused by environmental changes and that frequent short visits of an unfamiliar environment are detrimental rather than beneficial. Together, these insights can serve to refine experimental studies and design paradigms maximizing the birds’ wellbeing and vocal output.
- Open Access
- 3 July 2024
- Published by eLife Sciences Publications, Ltd in eLife
- Vol. 12
Goal-directed vocal planning in a songbird
Songbirds’ vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs toward the target by about 1 standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.
- 3 July 2024
- Published by eLife Sciences Publications, Ltd in eLife
- Vol. 12
Open AccessGoal-directed vocal planning in a songbird
Songbirds’ vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs toward the target by about 1 standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.
- Open Access
Familiarity of an environment prevents song suppression in isolated zebra finches
Despite the wide use of zebra finches as an animal model to study vocal learning and production, little is known about impacts on their welfare caused by routine experimental manipulations such as changing their social context. Here we conduct a post-hoc analysis of singing rate, an indicator of positive welfare, to gain insights into stress caused by social isolation, a common experimental manipulation. We find that isolation in an unfamiliar environment reduces singing rate for several days, indicating the presence of an acute stressor. However, we find no such decrease when social isolation is caused by either removal of a social companion or by transfer to a familiar environment. Furthermore, during repeated brief periods of isolation, singing rate remains high when isolation is induced by removal of social companions, but it fails to recover from a suppressed state when isolation is induced by recurrent transfer to an unknown environment. These findings suggest that stress from social isolation is negligible compared to stress caused by environmental changes and that frequent short visits of an unfamiliar environment are detrimental rather than beneficial. Together, these insights can serve to refine experimental studies and design paradigms maximizing the birds’ wellbeing and vocal output.
Open AccessFamiliarity of an environment prevents song suppression in isolated zebra finches
Despite the wide use of zebra finches as an animal model to study vocal learning and production, little is known about impacts on their welfare caused by routine experimental manipulations such as changing their social context. Here we conduct a post-hoc analysis of singing rate, an indicator of positive welfare, to gain insights into stress caused by social isolation, a common experimental manipulation. We find that isolation in an unfamiliar environment reduces singing rate for several days, indicating the presence of an acute stressor. However, we find no such decrease when social isolation is caused by either removal of a social companion or by transfer to a familiar environment. Furthermore, during repeated brief periods of isolation, singing rate remains high when isolation is induced by removal of social companions, but it fails to recover from a suppressed state when isolation is induced by recurrent transfer to an unknown environment. These findings suggest that stress from social isolation is negligible compared to stress caused by environmental changes and that frequent short visits of an unfamiliar environment are detrimental rather than beneficial. Together, these insights can serve to refine experimental studies and design paradigms maximizing the birds’ wellbeing and vocal output.
- Open Access
- 7 May 2024
- Published by eLife Sciences Publications, Ltd in eLife preprints
- Vol. 12
Goal-directed vocal planning in a songbird
Songbirds’ vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs towards the target by about one standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.
- 7 May 2024
- Published by eLife Sciences Publications, Ltd in eLife preprints
- Vol. 12
Open AccessGoal-directed vocal planning in a songbird
Songbirds’ vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs towards the target by about one standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.
- Open Access
- 29 March 2024
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 10 (13) , eadj3824
Learning the sound inventory of a complex vocal skill via an intrinsic reward
Reinforcement learning (RL) is thought to underlie the acquisition of vocal skills like birdsong and speech, where sounding like one’s “tutor” is rewarding. However, what RL strategy generates the rich sound inventories for song or speech? We find that the standard actor-critic model of birdsong learning fails to explain juvenile zebra finches’ efficient learning of multiple syllables. However, when we replace a single actor with multiple independent actors that jointly maximize a common intrinsic reward, then birds’ empirical learning trajectories are accurately reproduced. The influence of each actor (syllable) on the magnitude of global reward is competitively determined by its acoustic similarity to target syllables. This leads to each actor matching the target it is closest to and, occasionally, to the competitive exclusion of an actor from the learning process (i.e., the learned song). We propose that a competitive-cooperative multi-actor RL (MARL) algorithm is key for the efficient learning of the action inventory of a complex skill.
- 29 March 2024
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 10 (13) , eadj3824
Open AccessLearning the sound inventory of a complex vocal skill via an intrinsic reward
Reinforcement learning (RL) is thought to underlie the acquisition of vocal skills like birdsong and speech, where sounding like one’s “tutor” is rewarding. However, what RL strategy generates the rich sound inventories for song or speech? We find that the standard actor-critic model of birdsong learning fails to explain juvenile zebra finches’ efficient learning of multiple syllables. However, when we replace a single actor with multiple independent actors that jointly maximize a common intrinsic reward, then birds’ empirical learning trajectories are accurately reproduced. The influence of each actor (syllable) on the magnitude of global reward is competitively determined by its acoustic similarity to target syllables. This leads to each actor matching the target it is closest to and, occasionally, to the competitive exclusion of an actor from the learning process (i.e., the learned song). We propose that a competitive-cooperative multi-actor RL (MARL) algorithm is key for the efficient learning of the action inventory of a complex skill.