Automated characterization of perceptual quality of clinical chest radiographs: Validation and calibration to observer preference
Authors:
- 30 November 2014
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 41 (11) , 111918
Abstract
Purpose: The authors previously proposed an image‐based technique [Y. Lin et al. Med. Phys. 39, 7019–7031 (2012)] to assess the perceptual quality of clinical chest radiographs. In this study, an observer study was designed and conducted to validate the output of the program against rankings by expert radiologists and to establish the ranges of the output values that reflect the acceptable image appearance so the program output can be used for image quality optimization and tracking.Methods: Using an IRB‐approved protocol, 2500 clinical chest radiographs (PA/AP) were collected from our clinical operation. The images were processed through our perceptual quality assessment program to measure their appearance in terms of ten metrics of perceptual image quality: lung gray level, lung detail, lung noise, rib–lung contrast, rib sharpness, mediastinum detail, mediastinum noise, mediastinum alignment, subdiaphragm–lung contrast, and subdiaphragm area. From the results, for each targeted appearance attribute/metric, 18 images were selected such that the images presented a relatively constant appearance with respect to all metrics except the targeted one. The images were then incorporated into a graphical user interface, which displayed them into three panels of six in a random order. Using a DICOM calibrated diagnostic display workstation and under low ambient lighting conditions, each of five participating attending chest radiologists was tasked to spatially order the images based only on the targeted appearance attribute regardless of the other qualities. Once ordered, the observer also indicated the range of image appearances that he/she considered clinically acceptable. The observer data were analyzed in terms of the correlations between the observer and algorithmic rankings and interobserver variability. An observer‐averaged acceptable image appearance was also statistically derived for each quality attribute based on the collected individual acceptable ranges.Results: The observer study indicated that, for each image quality attribute, the averaged observer ranking strongly correlated with the algorithmic ranking (linear correlation coefficient R > 0.92), with highest correlation (R = 1) for lung gray level and the lowest (R = 0.92) for mediastinum noise. There was a strong concordance between the observers in terms of their rankings (i.e., Kendall's tau agreement > 0.84). The observers also generally indicated similar tolerance and preference levels in terms of acceptable ranges, as 85% of the values were close to the overall tolerance or preference levels and the differences were smaller than 0.15.Conclusions: The observer study indicates that the previously proposed technique provides a robust reflection of the perceptual image quality in clinical images. The results established the range of algorithmic outputs for each metric that can be used to quantitatively assess and qualify the appearance quality of clinical chest radiographs.Keywords
Funding Information
- Carestream Health (Carestream Health Incorporated)
- Carestream Health
- Carestream Health
This publication has 16 references indexed in Scilit:
- An image‐based technique to assess the perceptual quality of clinical chest radiographsMedical Physics, 2012
- Dose and perceived image quality in chest radiographyEuropean Journal of Radiology, 2009
- Digital radiography: The balance between image quality and required radiation doseEuropean Journal of Radiology, 2009
- Effective DQE (eDQE) and speed of digital radiographic systems: An experimental methodologyMedical Physics, 2009
- Assessment of Detective Quantum Efficiency: Intercomparison of a Recently Introduced International Standard with Prior Methods1Radiology, 2007
- Towards optimization in digital chest radiography using Monte Carlo modellingPhysics in Medicine & Biology, 2006
- Comparison of Eight Different Digital Chest Radiography Systems: Variation in Detection of Simulated Chest DiseaseAmerican Journal of Roentgenology, 2005
- Schemes for the optimization of chest radiography using a computer model of the patient and x‐ray imaging systemMedical Physics, 2001
- A method for measuring the presampled MTF of digital radiographic systems using an edge test deviceMedical Physics, 1998
- A simple method for determining the modulation transfer function in digital radiographyIEEE Transactions on Medical Imaging, 1992