There are numerous methods for assessing image quality in diagnostic X ray. In our study we assessed how imaging quality assurance methods perform in practice. Physics assessments were based on IPEM protocols using Leeds test objects. Clinical assessment was based on a questionnaire. A total of 15 systems in three European locations were assessed, covering a range of image intensifier-TV digital fluoroscopy units. Analysis of 274 clinical questionnaires showed that clinical and physics assessments did not place systems in the same order, based on a given image quality parameter. In almost all the comparisons, low level correlation was measured for statistical comparison of rank order (rs < 0.3). However, broad agreement was observed between physics and clinical assessments for image quality associated with contrast and noise. This study emphasises the importance of maintaining links with clinical assessment, when developing quality assurance metrics, and measuring the mutual performance of clinical and physical assessments of image quality.