Unsupervised adversarial neural network for enhancing vasculature in photoacoustic tomography images using optical coherence tomography angiography

Comput Med Imaging Graph. 2024 Oct:117:102425. doi: 10.1016/j.compmedimag.2024.102425. Epub 2024 Aug 28.

Abstract

Photoacoustic tomography (PAT) is a powerful imaging modality for visualizing tissue physiology and exogenous contrast agents. However, PAT faces challenges in visualizing deep-seated vascular structures due to light scattering, absorption, and reduced signal intensity with depth. Optical coherence tomography angiography (OCTA) offers high-contrast visualization of vasculature networks, yet its imaging depth is limited to a millimeter scale. Herein, we propose OCPA-Net, a novel unsupervised deep learning method that utilizes the rich vascular feature of OCTA to enhance PAT images. Trained on unpaired OCTA and PAT images, OCPA-Net incorporates a vessel-aware attention module to enhance deep-seated vessel details captured from OCTA. It leverages a domain-adversarial loss function to enforce structural consistency and a novel identity invariant loss to mitigate excessive image content generation. We validate the structural fidelity of OCPA-Net on simulation experiments, and then demonstrate its vascular enhancement performance on in vivo imaging experiments of tumor-bearing mice and contrast-enhanced pregnant mice. The results show the promise of our method for comprehensive vessel-related image analysis in preclinical research applications.

Keywords: Image enhancement; Optical coherence tomography angiography; Photoacoustic tomography; Vascular structures.

MeSH terms

  • Angiography* / methods
  • Animals
  • Female
  • Mice
  • Neural Networks, Computer*
  • Photoacoustic Techniques* / methods
  • Pregnancy
  • Tomography, Optical Coherence* / methods
  • Unsupervised Machine Learning