Creating realistic anterior segment optical coherence tomography images using generative adversarial networks

Br J Ophthalmol. 2024 Sep 20;108(10):1414-1422. doi: 10.1136/bjo-2023-324633.

Abstract

Aims: To develop a generative adversarial network (GAN) capable of generating realistic high-resolution anterior segment optical coherence tomography (AS-OCT) images.

Methods: This study included 142 628 AS-OCT B-scans from the American University of Beirut Medical Center. The Style and WAvelet based GAN architecture was trained to generate realistic AS-OCT images and was evaluated through the Fréchet Inception Distance (FID) Score and a blinded assessment by three refractive surgeons who were asked to distinguish between real and generated images. To assess the suitability of the generated images for machine learning tasks, a convolutional neural network (CNN) was trained using a dataset of real and generated images over a classification task. The generated AS-OCT images were then upsampled using an enhanced super-resolution GAN (ESRGAN) to achieve high resolution.

Results: The generated images exhibited visual and quantitative similarity to real AS-OCT images. Quantitative similarity assessed using FID scored an average of 6.32. Surgeons scored 51.7% in identifying real versus generated images which was not significantly better than chance (p value >0.3). The CNN accuracy improved from 78% to 100% when synthetic images were added to the dataset. The ESRGAN upsampled images were objectively more realistic and accurate compared with traditional upsampling techniques by scoring a lower Learned Perceptual Image Patch Similarity of 0.0905 compared with 0.4244 of bicubic interpolation.

Conclusions: This study successfully developed and leveraged GANs capable of generating high-definition synthetic AS-OCT images that are realistic and suitable for machine learning and image analysis tasks.

Keywords: Anterior chamber; Imaging; Phakic Intraocular Lenses; Treatment Lasers.

MeSH terms

  • Anterior Eye Segment* / diagnostic imaging
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Maschinelles Lernen
  • Neural Networks, Computer*
  • Tomography, Optical Coherence* / methods