Automatic identification of the endangered Hawksbill sea turtle behavior using deep learning and cross-species transfer

J Exp Biol. 2024 Nov 18:jeb.249232. doi: 10.1242/jeb.249232. Online ahead of print.

Abstract

The accelerometer, an onboard sensor, enables remote monitoring of animal posture and movement, allowing researchers to deduce behaviors. Despite the automated analysis capabilities provided by deep learning, data scarcity remains a challenge in ecology. We explored transfer learning to classify behaviors from acceleration data of critically endangered hawksbill sea turtles (Eretmochelys imbricata). Transfer learning reuses a model trained on one task from a large dataset to solve a related task. We applied this method using a model trained on green turtles (Chelonia mydas) and adapted it to identify hawksbill behaviors like swimming, resting, and feeding. We also compared this to a model trained on human activity data. Results showed an 8% and 4% F1-score improvement with transfer learning from green turtle and human datasets, respectively. Transfer learning allows researchers to adapt existing models to their study species, leveraging deep learning and expanding the use of accelerometers for wildlife monitoring.

Keywords: Accelerometer; Behavioral Classification; Bio-logging; Deep Learning; Sea Turtles; Transfer Learning.