Rapid 4D-MRI reconstruction using a deep radial convolutional neural network: Dracula

Radiother Oncol. 2021 Jun:159:209-217. doi: 10.1016/j.radonc.2021.03.034. Epub 2021 Apr 2.

Abstract

Background and purpose: 4D and midposition MRI could inform plan adaptation in lung and abdominal MR-guided radiotherapy. We present deep learning-based solutions to overcome long 4D-MRI reconstruction times while maintaining high image quality and short scan times.

Methods: Two 3D U-net deep convolutional neural networks were trained to accelerate the 4D joint MoCo-HDTV reconstruction. For the first network, gridded and joint MoCo-HDTV-reconstructed 4D-MRI were used as input and target data, respectively, whereas the second network was trained to directly calculate the midposition image. For both networks, input and target data had dimensions of 256 × 256 voxels (2D) and 16 respiratory phases. Deep learning-based MRI were verified against joint MoCo-HDTV-reconstructed MRI using the structural similarity index (SSIM) and the naturalness image quality evaluator (NIQE). Moreover, two experienced observers contoured the gross tumour volume and scored the images in a blinded study.

Results: For 12 subjects, previously unseen by the networks, high-quality 4D and midposition MRI (1.25 × 1.25 × 3.3 mm3) were each reconstructed from gridded images in only 28 seconds per subject. Excellent agreement was found between deep-learning-based and joint MoCo-HDTV-reconstructed MRI (average SSIM ≥ 0.96, NIQE scores 7.94 and 5.66). Deep-learning-based 4D-MRI were clinically acceptable for target and organ-at-risk delineation. Tumour positions agreed within 0.7 mm on midposition images.

Conclusion: Our results suggest that the joint MoCo-HDTV and midposition algorithms can each be approximated by a deep convolutional neural network. This rapid reconstruction of 4D and midposition MRI facilitates online treatment adaptation in thoracic or abdominal MR-guided radiotherapy.

Keywords: 4D MRI; Deep convolutional neural networks; MR-Linac; Magnetic resonance guided radiotherapy; Radiotherapy treatment planning.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Humans
  • Image Processing, Computer-Assisted
  • Imaging, Three-Dimensional*
  • Lung Neoplasms* / diagnostic imaging
  • Lung Neoplasms* / radiotherapy
  • Magnetic Resonance Imaging
  • Neural Networks, Computer