Insect Size Matters: Using Image and Dimensions Together Improves Image Classification

Authors:
Preprint
Publisher website
Google Scholar
Abstract
Although visual features have been the cornerstone of insect recognition, morphological traits are often overlooked by modern “scale-invariant” deep learning-based methods. One such trait is absolute body size, which is commonly used by entomologists to describe species. We propose a novel approach that integrates explicit size information into computer vision models. Our method improves predictions of a Convolutional Neural Network (ResNet) by incorporating the likelihood of an insect belonging to each class based on its size and the size distribution of the training data. We compare the performance of the proposed size-aware approach against a standard ResNet and a feature-fused ResNet model, demonstrating that incorporating explicit dimensional traits, such as body size, can enhance classification accuracy across both balanced and imbalanced dataset scenarios. Our results also show that incorporating size reduces classification error, especially in low-data scenarios and for hierarchically coarse, taxonomic misclassifications (e.g., errors at the family level). Despite being readily available and computationally inexpensive, size has, to our knowledge, not been used in this context before. We show that explicitly including size is both computationally efficient and practical, as it requires no specialized sensors and can be derived from standard image segmentation. This makes our approach highly scalable for automated monitoring of insects with camera traps. By acknowledging the importance of size, our approach also contributes to more robust and interpretable ecological modeling. This work opens new avenues for biologically informed AI applications in entomology and beyond.
All Related Versions
Funding Information
  • Novo Nordisk Foundation Start Package Grant (NNF22OC0077040)

This publication has 26 references indexed in Scilit: