From Pixels to Pods: Integrating Drones and Machine Learning Techniques to Understand Cetacean Social Dynamics
- 12 August 2026
- journal article
- Published by Wiley in Marine Mammal Science
- Vol. 42 (4)
Abstract
Our ability to study the fine‐scale behavior of cetaceans is evolving rapidly with the use of drones (or unoccupied aircraft systems) as platforms to observe and record behavior and with the emergence of machine learning and data science tools to quantify these observations. Together, these tools can provide an unprecedented perspective on the surface and near‐surface behaviors of cetaceans and the dynamics of their social groups. However, the use of machine learning to study cetacean behavior lags behind its application in other areas, such as cetacean acoustics and photo‐identification. In this review, we discuss the challenges and opportunities of combining these technologies to quantify cetacean social dynamics, and we present recent advances in the development of machine learning pipelines that go beyond the detection of animals. We also consider strategies that can improve the performance of models in individual studies, and as a broader research community, to allow the development of more effective and more generalizable tools.Keywords
This publication has 78 references indexed in Scilit:
- Model-based Metric 3D Shape and Motion Reconstruction of Wild Bottlenose Dolphins in Drone-Shot VideosInternational Journal of Computer Vision, 2026
- Distance defines us: determining dolphin group membership through analysis of inter-individual distancesBehavioral Ecology and Sociobiology, 2026
- An actionable framework for AI‐ready dataAI Magazine, 2026
- Automated cetacean detection in UAV imagery using AI models: a case study on Delphinid speciesInternational Journal of Data Science and Analytics, 2025
- Long-term observations reveal short-term mother–calf affiliation in wild harbour porpoisesAnimal Behaviour, 2024
- Flanking female guides: collective decision making in long-finned pilot whalesAnimal Behaviour, 2023
- Drone Perspectives on Cetacean Mating and Sex2023
- Quantifying the age structure of free‐ranging delphinid populations: Testing the accuracy of Unoccupied Aerial System photogrammetryEcology and Evolution, 2023
- Using Unoccupied Aerial Vehicles to estimate availability and group size error for aerial surveys of coastal dolphinsRemote Sensing in Ecology and Conservation, 2022
- Dolphin movement direction recognition using contour-skeleton informationMultimedia Tools and Applications, 2020