A novel end-to-end dual-camera system for eye gaze synchrony assessment in face-to-face interaction

Atten Percept Psychophys. 2024 Oct;86(7):2221-2230. doi: 10.3758/s13414-023-02679-4. Epub 2023 Apr 26.

Abstract

Quantification of face-to-face interaction can provide highly relevant information in cognitive and psychological science research. Current commercial glint-dependent solutions suffer from several disadvantages and limitations when applied in face-to-face interaction, including data loss, parallax errors, the inconvenience and distracting effect of wearables, and/or the need for several cameras to capture each person. Here we present a novel eye-tracking solution, consisting of a dual-camera system used in conjunction with an individually optimized deep learning approach that aims to overcome some of these limitations. Our data show that this system can accurately classify gaze location within different areas of the face of two interlocutors, and capture subtle differences in interpersonal gaze synchrony between two individuals during a (semi-)naturalistic face-to-face interaction.

Keywords: Deep learning; Dyadic interaction; Eye tracking; Face-to-face contact; Interpersonal synchronization.

MeSH terms

  • Adult
  • Deep Learning
  • Eye-Tracking Technology*
  • Facial Recognition / physiology
  • Female
  • Fixation, Ocular*
  • Humans
  • Interpersonal Relations
  • Male
  • Social Interaction
  • Young Adult