Face swapping in seizure videos for patient deidentification

Epilepsy Res. 2024 Nov:207:107453. doi: 10.1016/j.eplepsyres.2024.107453. Epub 2024 Sep 18.

Abstract

Objective: This study aimed to test different AI-based face-swapping models applied to videos of epileptic seizures, with the goal of protecting patient privacy while retaining clinically useful seizure semiology. We hypothesized that specific models would show differences in semiologic fidelity compared to the original clinical videos.

Methods: Three open-source models, SimSwap, MobileFaceSwap and GHOST were adopted for face-swapping. For every model, an AI generated male and female image were used to replace the original faces. One representative seizure per patient from three patients with epilepsy was chosen (3 seizure videos x 3 AI models x 2 M/F swap) and remade to 18 transformed video clips. To evaluate the performance of the three models, we used both objective (AI-based) and subjective (expert clinician) evaluation. The objective assessment included four metrics for facial appearance and four metrics for facial expression changes. Four experienced epileptologists reviewed the clips and scoring according to deidentification and preservation of semiology. Kruskal-Wallis H test was used for statistical analysis among the models.

Results: In the reproduced videos, the swapped face cannot be recognized as the original face, with no significant difference in scores of deidentification either by objective or subjective assessment. Regarding semiology preservation, no significant differences between models were observed in the objective evaluations. The subjective evaluations revealed that the GHOST model outperformed the other two models (p=0.028).

Conclusion: This is the first study evaluating AI face swapping models in epileptic seizure video clips. Optimization of AI face-swapping models could enhance the accessibility of seizure videos for education and research while protecting patient privacy and maintaining semiology.

Keywords: Epilepsy; Face-swapping; Medical AI; Privacy protection; Seizure videos; Semiology.

MeSH terms

  • Artificial Intelligence
  • Epilepsy / physiopathology
  • Face
  • Facial Expression
  • Female
  • Humans
  • Male
  • Seizures* / physiopathology
  • Video Recording* / methods