Deep learning and computer vision will transform entomology
Authors:
Preprint
Abstract
Most animal species on Earth are insects, and recent reports suggest that their abundance is in drastic decline. Although these reports come from a wide range of insect taxa and regions, the evidence to assess the extent of the phenomenon is still sparse. Insect populations are challenging to study and most monitoring methods are labour intensive and inefficient. Advances in computer vision and deep learning provide potential new solutions to this global challenge. Cameras and other sensors that can effectively, continuously, and non-invasively perform entomological observations throughout diurnal and seasonal cycles. The physical appearance of specimens can also be captured by automated imaging in the lab. When trained on these data, deep learning models can provide estimates of insect abundance, biomass, and diversity. Further, deep learning models can quantify variation in phenotypic traits, behaviour, and interactions. Here, we connect recent developments in deep learning and computer vision to the urgent demand for more cost-efficient monitoring of insects and other invertebrates. We present examples of sensor-based monitoring of insects. We show how deep learning tools can be applied to the big data outputs to derive ecological information and discuss the challenges that lie ahead for the implementation of such solutions in entomology. We identify four focal areas, which will facilitate this transformation: 1) Validation of image-based taxonomic identification, 2) generation of sufficient training data, 3) development of public, curated reference databases, and 4) solutions to integrate deep learning and molecular tools. Significance statement: Insect populations are challenging to study, but computer vision and deep learning provide opportunities for continuous and non-invasive monitoring of biodiversity around the clock and over entire seasons. These tools can also facilitate the processing of samples in a laboratory setting. Automated imaging in particular can provide an effective way of identifying and counting specimens to measure abundance. We present examples of sensors and devices of relevance to entomology and show how deep learning tools can convert the big data streams into ecological information. We discuss the challenges that lie ahead and identify four focal areas to make deep learning and computer vision game changers for entomology.Keywords
All Related Versions
- Published version: Proceedings of the National Academy of Sciences, 118 (2).
This publication has 115 references indexed in Scilit:
- A DNA-Based Registry for All Animal Species: The Barcode Index Number (BIN) SystemPLOS ONE, 2013
- Towards good practice guidance in using camera‐traps in ecology: influence of sampling design on validity of ecological inferencesMethods in Ecology and Evolution, 2012
- No specimen left behind: industrial scale digitization of natural history collectionsZooKeys, 2012
- The seven impediments in invertebrate conservation and how to overcome themBiological Conservation, 2011
- Recent Insights from Radar Studies of Insect FlightAnnual Review of Entomology, 2011
- Time to automate identificationNature, 2010
- bold: The Barcode of Life Data System (http://www.barcodinglife.org)Molecular Ecology Notes, 2007
- Migratory and foraging movements in beneficial insects: A review of radar monitoring and tracking methodsInternational Journal of Pest Management, 2004
- High‐altitude migration of the diamondback moth Plutella xylostella to the U.K.: a study using radar, aerial netting, and ground trappingEcological Entomology, 2002
- Development of vertical-looking radar technology for monitoring insect migrationComputers and Electronics in Agriculture, 2002