Optimizing Radiological Education: The Role of Learning Spacing via Test sets in Enhancing Diagnostic Proficiency in Breast Screening Readers

Rationale and objectives: Integrating learning spacing in medicine has shown promise in enhancing knowledge retention and diagnostic proficiency. While studies demonstrate the effectiveness of spaced learning in various fields, limited research exists on its application in radiological training. This study aims to investigate the impact of intervals in spaced training on radiologists' and trainees' diagnostic performance via mammogram test sets.

Methods: 54 radiologists and 101 radiology trainees completed 207 and 458 first-time readings of 9 mammogram test sets between 2019 and 2023. Each test set comprised of 60 mammograms (20 cancer and 40 normal), sourced retrospectively from BreastScreen Australia. Each radiologist evaluated mammograms using the BIRADS lexicon. Readers' performance was compared with truth data and evaluated in terms of specificity, case sensitivity, lesion sensitivity, ROC AUC and JAFROC FOM. The progress of readers' performances in following test sets after the first one was analyzed using Wilcoxon Signed Rank test. The association of participants' performances and the intervals among test sets' completions was investigated using Pearson's test.

Results: Significant positive correlations were found between intervals and radiologists' improvement in specificity and JAFROC FOM (P < 0.05). The separation of 4 to 10 days showed the most improvement among radiologists across all metrics, while intervals exceeding 90 days related to highest increase in case sensitivity (5.15%), lesion sensitivity (6.55%), ROC AUC (3.05%) and JAFROC FOM (6.3%). Trainees completing test sets in one day showed positive correlations with their ROC AUC (R=0.45; P = 0.008) and JAFROC FOM (R=0.43; P = 0.02), while those taking a longer time to complete showed negative impacts on case sensitivity (P = 0.009) and ROC AUC (P = 0.02). Remarkable progress in trainees was found in case sensitivity (6.15%), lesion sensitivity (11.6%), ROC AUC (3.5%) and JAFROC FOM (4.35%) with test set intervals of 31-90 days.

Conclusions: Radiologists demonstrated superior performance when the training test sets were spaced over longer intervals, whereas trainees exhibited proficiency with shorter time separations. By optimizing the spacing of reviewing and practicing radiological concepts, mammogram readers can bolster memory retention and diagnostic decision-making skills.