Challenges and solutions for automated avian recognition in aerial imagery
Authors:
Open Access
- 26 April 2023
- journal article
- research article
- Published by Wiley in Remote Sensing in Ecology and Conservation
- Vol. 9 (4) , 439-453
Abstract
Remote aerial sensing provides a non‐invasive, large geographical‐scale technology for avian monitoring, but the manual processing of images limits its development and applications. Artificial Intelligence (AI) methods can be used to mitigate this manual image processing requirement. The implementation of AI methods, however, has several challenges: (1) imbalanced (i.e., long‐tailed) data distribution, (2) annotation uncertainty in categorization, and (3) dataset discrepancies across different study sites. Here we use aerial imagery data of waterbirds around Cape Cod and Lake Michigan in the United States to examine how these challenges limit avian recognition performance. We review existing solutions and demonstrate as use cases how methods like Label Distribution Aware Marginal Loss with Deferred Re‐Weighting, hierarchical classification, and FixMatch address the three challenges. We also present a new approach to tackle the annotation uncertainty challenge using a Soft‐fine Pseudo‐Label methodology. Finally, we aim with this paper to increase awareness in the ecological remote sensing community of these challenges and bridge the gap between ecological applications and state‐of‐the‐art computer science, thereby opening new doors to future research.Keywords
This publication has 47 references indexed in Scilit:
- Evaluation of unmanned aerial vehicle shape, flight path and camera type for waterfowl surveys: disturbance effects and species recognitionPeerJ, 2016
- An invasive‐native mammalian species replacement process captured by camera trap survey random encounter modelsRemote Sensing in Ecology and Conservation, 2016
- The biodiversity of species and their rates of extinction, distribution, and protectionScience, 2014
- Toward Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- An automatic counter for aerial images of aggregations of large birdsBird Study, 2011
- Four opportunities for studies of ecological successionTrends in Ecology & Evolution, 2011
- Adapting Visual Category Models to New Domains2010
- Multi-Label ClassificationInternational Journal of Data Warehousing and Mining, 2007
- Invasive species are a leading cause of animal extinctionsTrends in Ecology & Evolution, 2005
- Accuracy and variation in estimates of large numbers of birds by individual observers using an aerial survey simulatorJournal of Field Ornithology, 2003