orcAI : A Machine Learning Tool to Detect and Classify Acoustic Signals of Killer Whales in Audio Recordings
Open Access
- 7 October 2025
- journal article
- Published by Wiley in Marine Mammal Science
- Vol. 42 (1)
Abstract
Acoustic monitoring is an essential tool for investigating animal communication and behavior when visual contact is limited, but the scalability of bioacoustic projects is often limited by time‐intensive manual auditing of focal signals. To address this bottleneck, we introduce orcAI—a novel deep learning framework for the automated detection and classification of a broad acoustic repertoire of killer whales ( Orcinus orca ), including vocalizations (e.g., pulsed calls, whistles) and incidental sounds (e.g., breathing, tail slaps). orcAI combines a ResNet‐based Convolutional Neural Network (ResNet‐CNN) with Long Short‐Term Memory (LSTM) layers to capture both spatial features and temporal context, enabling the model to classify signals and to accurately determine their temporal boundaries in spectrograms. Trained on a comprehensive dataset from herring‐feeding killer whales off Iceland, the framework was designed to be adaptable to other populations upon training with equivalent data. Our final model achieves up to 98.2% accuracy on test data and is delivered as an open‐source tool with an easy‐to‐use command‐line interface. By providing a ready‐to‐use model that processes raw audio and outputs annotations, orcAI serves as a useful tool for advancing the study of killer whale vocal behavior and, more broadly, for understanding marine mammal communication and ecology.Keywords
Funding Information
- Eidgenössische Technische Hochschule Zürich
- Rannís (120248042)
- Rannís (163060)
- Rannís (217519)
- Rannís (200229)
- Fundação para a Ciência e a Tecnologia (SFRH/BD/30303/2006)
- Earthwatch Institute
This publication has 39 references indexed in Scilit:
- Sound production during feeding in Icelandic herring-eating killer whales ( Orcinus orca )Ethology Ecology & Evolution, 2025
- Automatic bat call classification using transformer networksEcological Informatics, 2023
- Sperm whale predator-prey interactions involve chasing and buzzing, but no acoustic stunningScientific Reports, 2016
- Variations in killer whale food-associated calls produced during different prey behavioural contextsBehavioural Processes, 2015
- Visualizing and Understanding Convolutional Networks2014
- Killer Whale2009
- The evolution of echolocation in batsTrends in Ecology & Evolution, 2006
- ICELANDIC KILLER WHALESORCINUS ORCAUSE A PULSED CALL SUITABLE FOR MANIPULATING THE SCHOOLING BEHAVIOUR OF HERRINGCLUPEA HARENGUSBioacoustics, 2006
- EcholocationCurrent Biology, 2005
- Individualized Whistle Contours in Bottle-nosed Dolphins (Tursiops truncatus)Nature, 1965