In modern clinical decision-support algorithms, heterogeneity in image characteristics due to variations in imaging systems and protocols hinders the development of reproducible quantitative measures including for feature extraction pipelines. With the help of a reader study, we investigate the ability to provide consistent ground-truth targets by using patient-specific 3D-printed lung phantoms. PixelPrint was developed for 3D-printing lifelike computed tomography (CT) lung phantoms by directly translating clinical images into printer instructions that control density on a voxel-by-voxel basis. Data sets of three COVID-19 patients served as input for 3D-printing lung phantoms. Five radiologists rated patient and phantom images for imaging characteristics and diagnostic confidence in a blinded reader study. Effect sizes of evaluating phantom as opposed to patient images were assessed using linear mixed models. Finally, PixelPrint's production reproducibility was evaluated. Images of patients and phantoms had little variation in the estimated mean (0.03-0.29, using a 1-5 scale). When comparing phantom images to patient images, effect size analysis revealed that the difference was within one-third of the inter- and intrareader variabilities. High correspondence between the four phantoms created using the same patient images was demonstrated by PixelPrint's production repeatability tests, with greater similarity scores between high-dose acquisitions of the phantoms than between clinical-dose acquisitions of a single phantom. We demonstrated PixelPrint's ability to produce lifelike CT lung phantoms reliably. These phantoms have the potential to provide ground-truth targets for validating the generalizability of inference-based decision-support algorithms between different health centers and imaging protocols and for optimizing examination protocols with realistic patient-based phantoms. Classification: CT lung phantoms, reader study.
Keywords: computed tomography; lung imaging; phantoms; reader study; three-dimensional printing.
© The Author(s) 2023. Published by Oxford University Press on behalf of National Academy of Sciences.