Supervised versus unsupervised approaches to classification of accelerometry data
Open Access
- 17 May 2023
- journal article
- research article
- Published by Wiley in Ecology and Evolution
- Vol. 13 (5) , e10035
Abstract
Sophisticated animal‐borne sensor systems are increasingly providing novel insight into how animals behave and move. Despite their widespread use in ecology, the diversity and expanding quality and quantity of data they produce have created a need for robust analytical methods for biological interpretation. Machine learning tools are often used to meet this need. However, their relative effectiveness is not well known and, in the case of unsupervised tools, given that they do not use validation data, their accuracy can be difficult to assess. We evaluated the effectiveness of supervised (n = 6), semi‐supervised (n = 1), and unsupervised (n = 2) approaches to analyzing accelerometry data collected from critically endangered California condors (Gymnogyps californianus). Unsupervised K‐means and EM (expectation–maximization) clustering approaches performed poorly, with adequate classification accuracies of 0.81. Kappa statistics were also highest for RF and kNN, in most cases substantially greater than for other modeling approaches. Unsupervised modeling, which is commonly used for the classification of a priori‐defined behaviors in telemetry data, can provide useful information but likely is instead better suited to post hoc definition of generalized behavioral states. This work also shows the potential for substantial variation in classification accuracy among different machine learning approaches and among different metrics of accuracy. As such, when analyzing biotelemetry data, best practices appear to call for the evaluation of several machine learning techniques and several measures of accuracy for each dataset under consideration.Keywords
Funding Information
- California Department of Fish and Wildlife (P1182024, P148006)
- National Fish and Wildlife Foundation (806.17.055715)
This publication has 53 references indexed in Scilit:
- Transient windows for connectivity in a changing worldMovement Ecology, 2014
- Observing the unwatchable through acceleration logging of animal behaviorAnimal Biotelemetry, 2013
- Data Pre-processing2013
- From Sensor Data to Animal Behaviour: An Oystercatcher ExamplePLOS ONE, 2012
- Using tri-axial acceleration data to identify behavioral modes of free-ranging animals: general concepts and tools illustrated for griffon vulturesJournal of Experimental Biology, 2012
- Use of overall dynamic body acceleration for estimating energy expenditure in cormorantsJournal of Experimental Marine Biology and Ecology, 2011
- Exploratory analysis of benchmark experiments an interactive approachComputational Statistics, 2011
- Can Ethograms Be Automatically Generated Using Body Acceleration Data from Free-Ranging Birds?PLOS ONE, 2009
- Moving towards acceleration for estimates of activity‐specific metabolic rate in free‐living animals: the case of the cormorantJournal of Animal Ecology, 2006
- The Design and Analysis of Benchmark ExperimentsJournal of Computational and Graphical Statistics, 2005