Learning to predict perceptual visibility of rendering deterioration in computer games
Open Access
- 13 November 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-11
Abstract
Contemporary computer gaming affords players the agency to manually tailor rendering settings, a capability crucial for optimizing computational demands following their hardware performance. Specifically, adjustments to texture resolution, shadow map intricacies, and anti-aliasing complexities facilitate seamless animation generation, particularly on systems equipped with budget-friendly graphical units. Nonetheless, the intricacy and extensive interdependencies among these rendering parameters render selecting an optimal configuration a multifaceted challenge. Our approach involves training a proprietary convolutional neural network (CNN) to streamline this intricate process. This CNN quantitatively compares reference images rendered at peak quality to their counterparts subjected to quality reduction. Its function involves identifying and classifying artifacts within the altered images, and evaluating their perceptibility to human observers. Our neural network undergoes rigorous training using an expansive dataset derived from prevalent game engine scenes. A meticulous process to establish accurate classification data involves manually annotating image regions afflicted by diminished quality. As a testament to our methodology, we implement a prototype forward renderer based on OpenGL. Employing the trained neural network within this application enables the evaluation of image quality across diverse anti-aliasing settings, culminating in identifying settings minimizing artifact visibility. Empirical validation via user studies substantiates our network’s efficacy, demonstrating its superior discernment of artifact visibility compared to established image quality metrics.Keywords
This publication has 29 references indexed in Scilit:
- Predicting visual difference maps for computer‐generated images by integrating human visual system model and deep learningIET Image Processing, 2022
- Comparison of Full-Reference Image Quality Models for Optimization of Image Processing SystemsInternational Journal of Computer Vision, 2021
- Visual Quality of 3D Meshes With Diffuse Colors in Virtual Reality: Subjective and Objective EvaluationIEEE Transactions on Visualization and Computer Graphics, 2020
- Reliability of Local Ground Truth Data for Image Quality Metric Assessment2018
- Image-Difference Prediction: From Grayscale to ColorIEEE Transactions on Image Processing, 2012
- No-Reference Image Quality Assessment in the Spatial DomainIEEE Transactions on Image Processing, 2012
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Assessing the accuracy of prediction algorithms for classification: an overviewBioinformatics, 2000
- Color image fidelity metrics evaluated using image distortion mapsSignal Processing, 1998
- Autoassociative neural networksComputers & Chemical Engineering, 1992