Error Injection in Task-Based Image Quality Pipelines: What Regression Testing Cannot Catch, and Why Neither Internal Identities nor Closed-Form References Suffice Alone
Open Access
- 14 September 2026
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 12 (9) , 443
Abstract
Task-based image quality assessment—the modulation transfer function, the noise power spectrum (NPS), the noise-equivalent quanta and model observers—fails by returning a plausible wrong number rather than an error, and the regression test most implementations carry cannot tell a plausible right answer from a plausible wrong one, because the stored reference was recorded from the defective code. We injected six defects into a validated implementation of that chain through a severity dial that recovers the correct pipeline exactly at zero. A self-consistency regression test detected none of the six. Four internal identities, which need no ground truth, and two closed-form references, which need a phantom whose answer is known, together detected all six, in every case at or before the severity at which the reported detectability index became wrong by more than 5%—an error that three of the six never produced. Neither family sufficed alone: the internal identities detected three of the six and the closed-form references five, and peak errors in a reported reached 90%. Run unmodified on measured American College of Radiology (ACR) phantom projections across seven reconstruction kernels, the three identities that can be evaluated without ground truth transferred intact—Parseval held to —but their tolerances did not, and the strongest apodisation drove the noise dynamic range to within 0.6% of the threshold beyond which a prewhitening observer should return no value at all rather than a computed one, because has ceased to be numerically meaningful.
Keywords
Funding Information
- LISIT Co., Ltd.
- TexelCraft OU
This publication has 18 references indexed in Scilit:
- Phantom evaluation of small‐pixel effect in ultra‐high‐resolution photon‐counting CT: Noise texture and high‐contrast spatial resolutionJournal of Applied Clinical Medical Physics, 2026
- Low‐dose CT image and projection datasetMedical Physics, 2020
- Performance evaluation of computed tomography systems: Summary of AAPM Task Group 233Medical Physics, 2019
- Image quality in CT: From physical measurements to model observersPhysica Medica, 2015
- Task-based measures of image quality and their relation to radiation dose and patient riskPhysics in Medicine & Biology, 2015
- A simple approach to measure computed tomography (CT) modulation transfer function (MTF) and noise‐power spectrum (NPS) using the American College of Radiology (ACR) accreditation phantomMedical Physics, 2013
- Reproducible Research in Computational ScienceScience, 2011
- Computational science: ...ErrorNature, 2010
- An Analysis and Survey of the Development of Mutation TestingIEEE Transactions on Software Engineering, 2010
- Model observers for assessment of image quality.Proceedings of the National Academy of Sciences, 1993