A student trained convolutional neural network competing with a commercial AI software and experts in organ at risk segmentation

Sci Rep. 2024 Oct 29;14(1):25929. doi: 10.1038/s41598-024-76288-y.

Abstract

This retrospective, multi-centered study aimed to improve high-quality radiation treatment (RT) planning workflows by training and testing a Convolutional Neural Network (CNN) to perform auto segmentations of organs at risk (OAR) for prostate cancer (PCa) patients, specifically the bladder and rectum. The objective of this project was to develop a clinically applicable and robust artificial intelligence (AI) system to assist radiation oncologists in OAR segmentation. The CNN was trained using manual contours in CT-datasets from diagnostic 68Ga-PSMA-PET/CTs by a student, then validated (n = 30, PET/CTs) and tested (n = 16, planning CTs). Further segmentations were generated by a commercial artificial intelligence (cAI) software. The ground truth were manual contours from expert radiation oncologists. The performance was evaluated using the Dice-Sørensen Coefficient (DSC), visual analysis and a Turing test. The CNN yielded excellent results in both cohorts and OARs with a DSCmedian > 0.87, the cAI resulted in a DSC > 0.78. In the visual assessment, 67% (bladder) and 75% (rectum) of the segmentations were rated as acceptable for treatment planning. With a misclassification rate of 45.5% (bladder) and 51.1% (rectum), the CNN passed the Turing test. The metrics, visual assessment and the Turing test confirmed the clinical applicability and therefore the support in clinical routine.

Keywords: Artificial intelligence; Auto segmentation; Convolutional neural network; Prostate cancer; Radiation treatment planning; Turing test.

Publication types

  • Multicenter Study

MeSH terms

  • Artificial Intelligence
  • Humans
  • Male
  • Neural Networks, Computer*
  • Organs at Risk*
  • Positron Emission Tomography Computed Tomography
  • Prostatic Neoplasms* / diagnostic imaging
  • Prostatic Neoplasms* / radiotherapy
  • Radiotherapy Planning, Computer-Assisted / methods
  • Rectum / diagnostic imaging
  • Retrospective Studies
  • Software*
  • Urinary Bladder / diagnostic imaging