Objectives: As structured reporting is increasingly used in the evaluation of prostate-specific membrane antigen positron emission tomography/computed tomography (PSMA-PET/CT) for prostate cancer, there is a need to assess the reliability of these frameworks. This study aimed to evaluate the intra- and interreader agreement among readers with varying levels of experience using PSMA-RADS 1.0 for interpreting PSMA-PET/CT scans, even when blinded to clinical data, and therefore to determine the feasibility of implementing this reporting system in clinical practice.
Methods: PSMA-PET/CT scans of 103 patients were independently evaluated by 4 readers with different levels of experience according to the reporting and data system (RADS) for PSMA-PET/CT imaging PSMA-RADS 1.0 at 2 time points within 6 weeks. For each scan, a maximum of five target lesions were freely chosen and stratified according to PSMA-RADS 1.0. Overall scan score and compartment-based scores were assessed. Intra- and interreader agreement was determined using the intraclass correlation coefficient (ICC).
Results: PSMA-RADS 1.0 demonstrated excellent interreader agreement for both overall scan scores (ICC ≥ 0.91) and compartment-based scores (ICC ≥ 0.93) across all four readers. The framework showed excellent intrareader agreement for overall scan scores (ICC ≥ 0.86) and compartment-based scores (ICC ≥ 0.95), even among readers with varying levels of experience.
Conclusions: PSMA-RADS 1.0 is a reliable method for assessing PSMA-PET/CT with strong consistency and agreement among readers. It shows great potential for establishing a standard approach to diagnosing and planning treatment for prostate cancer patients, and can be used confidently even by readers with less experience.
Clinical relevance statement: This study underlines that PSMA-RADS 1.0 is a valuable and highly reliable scoring system for PSMA-PET/CT scans of prostate cancer patients and can be used confidently by radiologists with different levels of experience in routine clinical practice.
Key points: PSMA-RADS version 1.0 is a scoring system for PSMA-PET/CT scans. Its reproducibility needs to be analyzed in order to make it applicable to clinical practice. Excellent interreader and intrareader agreement for overall scan scores and compartment-based scores using PSMA-RADS 1.0 were seen in readers with varying levels of experience. PSMA-RADS 1.0 is a reliable tool for accurately diagnosing and planning treatment for prostate cancer patients, and can be used confidently in clinical routine.
Keywords: PSMA; Positron emission tomography computed tomography; Prostate cancer.
© 2023. The Author(s).