On-Bird Sound Recordings: Automatic Acoustic Recognition of Activities and Contexts
Open Access
- 23 May 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 25 (6) , 1193-1206
Abstract
We introduce a novel approach to studying animal behavior and the context in which it occurs, through the use of microphone backpacks carried on the backs of individual free-flying birds. These sensors are increasingly used by animal behavior researchers to study individual vocalizations of freely behaving animals, even in the field. However, such devices may record more than an animal's vocal behavior, and have the potential to be used for investigating specific activities (movement) and context (background) within which vocalizations occur. To facilitate this approach, we investigate the automatic annotation of such recordings through two different sound scene analysis paradigms: A scene-classification method using feature learning, and an event-detection method using probabilistic latent component analysis. We analyze recordings made with Eurasian jackdaws (Corvus monedula) in both captive and field settings. Results are comparable with the state of the art in sound scene analysis; we find that the current recognition quality level enables scalable automatic annotation of audio logger data, given partial annotation, but also find that individual differences between animals and/or their backpacks limit the generalization from one individual to another. we consider the interrelation of “scenes” and “events” in this particular task, and issues of temporal resolution.Keywords
All Related Versions
Funding Information
- EPSRC Early Career Research Fellowship (EP/L020505/1)
- U.K. Royal Academy of Engineering Research Fellowship (RF/128)
- Max Planck Society
This publication has 30 references indexed in Scilit:
- The energy cost of singing in wild rock hyrax males: evidence for an index signalAnimal Behaviour, 2013
- When is the area under the receiver operating characteristic curve an appropriate measure of classifier performance?Pattern Recognition Letters, 2013
- From Sensor Data to Animal Behaviour: An Oystercatcher ExamplePLOS ONE, 2012
- Eco-Virological Approach for Assessing the Role of Wild Birds in the Spread of Avian Influenza H5N1 along the Central Asian FlywayPLOS ONE, 2012
- Monitoring the wild black bear's reaction to human and environmental stressorsBMC Physiology, 2011
- BIODIVERSITY RESEARCH: Fidelity to foraging sites, consistency of migration routes and habitat modulation of home range by sea turtlesDiversity and Distributions, 2010
- On-board telemetry of emitted sounds from free-flying bats: compensation for velocity and distance stabilizes echo frequency and amplitudeJournal of Comparative Physiology A, 2008
- Probabilistic Latent Variable Models as Nonnegative FactorizationsComputational Intelligence and Neuroscience, 2008
- An introduction to ROC analysisPattern Recognition Letters, 2006
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989