Classifying stages in the gonotrophic cycle of mosquitoes from images using computer vision techniques
Open Access
- 13 December 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Abstract
The ability to distinguish between the abdominal conditions of adult female mosquitoes has important utility for the surveillance and control of mosquito-borne diseases. However, doing so requires entomological training and time-consuming manual effort. Here, we design computer vision techniques to determine stages in the gonotrophic cycle of female mosquitoes from images. Our dataset was collected from 139 adult female mosquitoes across three medically important species—Aedes aegypti, Anopheles stephensi, and Culex quinquefasciatus—and all four gonotrophic stages of the cycle (unfed, fully fed, semi-gravid, and gravid). From these mosquitoes and stages, a total of 1959 images were captured on a plain background via multiple smartphones. Subsequently, we trained four distinct AI model architectures (ResNet50, MobileNetV2, EfficientNet-B0, and ConvNeXtTiny), validated them using unseen data, and compared their overall classification accuracies. Additionally, we analyzed t-SNE plots to visualize the formation of decision boundaries in a lower-dimensional space. Notably, ResNet50 and EfficientNet-B0 demonstrated outstanding performance with an overall accuracy of 97.44% and 93.59%, respectively. EfficientNet-B0 demonstrated the best overall performance considering computational efficiency, model size, training speed, and t-SNE decision boundaries. We also assessed the explainability of this EfficientNet-B0 model, by implementing Grad-CAMs—a technique that highlights pixels in an image that were prioritized for classification. We observed that the highest weight was for those pixels representing the mosquito abdomen, demonstrating that our AI model has indeed learned correctly. Our work has significant practical impact. First, image datasets for gonotrophic stages of mosquitoes are not yet available. Second, our algorithms can be integrated with existing citizen science platforms that enable the public to record and upload biological observations. With such integration, our algorithms will enable the public to contribute to mosquito surveillance and gonotrophic stage identification. Finally, we are aware of work today that uses computer vision techniques for automated mosquito species identification, and our algorithms in this paper can augment these efforts by enabling the automated detection of gonotrophic stages of mosquitoes as well.Keywords
All Related Versions
Funding Information
- National Science Foundation (IIS-#2014547)
This publication has 25 references indexed in Scilit:
- Deep Residual Learning for Image Recognition2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Effect of blood meal digestion and DNA extraction protocol on the success of blood meal source determination in the malaria vector Anopheles atroparvusMalaria Journal, 2013
- Ascaris co-infection does not alter malaria-induced anaemia in a cohort of Nigerian preschool childrenMalaria Journal, 2013
- Ecology: A Prerequisite for Malaria Elimination and EradicationPLOS Medicine, 2010
- Use of the Sterile Insect Technique Against Aedes albopictus in Italy: First Results of a Pilot Trial2007
- APPLICATION OF AN ENZYME-LINKED IMMUNOSORBENT-ASSAY (ELISA) FOR DETERMINATION OF THE HUMAN-BLOOD INDEX IN ANOPHELINE MOSQUITOS COLLECTED IN IRAN1985
- Age-Grouping Methods in Diptera of Medical Importance: With Special Reference to Some Vectors of MalariaJournal of Parasitology, 1962
- Age-grouping methods in Diptera of medical importance with special reference to some vectors of malaria.1962
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951