Deep learning for identifying bee species from images of wings and pinned specimens

PLoS One. 2024 May 28;19(5):e0303383. doi: 10.1371/journal.pone.0303383. eCollection 2024.

Abstract

One of the most challenging aspects of bee ecology and conservation is species-level identification, which is costly, time consuming, and requires taxonomic expertise. Recent advances in the application of deep learning and computer vision have shown promise for identifying large bumble bee (Bombus) species. However, most bees, such as sweat bees in the genus Lasioglossum, are much smaller and can be difficult, even for trained taxonomists, to identify. For this reason, the great majority of bees are poorly represented in the crowdsourced image datasets often used to train computer vision models. But even larger bees, such as bumble bees from the B. vagans complex, can be difficult to separate morphologically. Using images of specimens from our research collections, we assessed how deep learning classification models perform on these more challenging taxa, qualitatively comparing models trained on images of whole pinned specimens or on images of bee forewings. The pinned specimen and wing image datasets represent 20 and 18 species from 6 and 4 genera, respectively, and were used to train the EfficientNetV2L convolutional neural network. Mean test precision was 94.9% and 98.1% for pinned and wing images respectively. Results show that computer vision holds great promise for classifying smaller, more difficult to identify bees that are poorly represented in crowdsourced datasets. Images from research and museum collections will be valuable for expanding classification models to include additional species, which will be essential for large scale conservation monitoring efforts.

MeSH terms

  • Animals
  • Bees / anatomy & histology
  • Bees / classification
  • Deep Learning*
  • Image Processing, Computer-Assisted / methods
  • Neural Networks, Computer
  • Species Specificity
  • Wings, Animal* / anatomy & histology

Grants and funding

This study was supported by Kansas State University (GRIPEX-2160-10060, to BJS) https://www.k-state.edu/research/faculty/funding/grip/grip-ex.html/ and by the United States Department of Agriculture, National Institute of Food and Agriculture (2020-67013-31862, to BJS) https://www.nifa.usda.gov; The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.