Optimizing Vulkan Dispatch Schedules for Real-Time U-Net Denoising 53
Open Access
- 29 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Vol. 9 (4) , 1-20
Abstract
Image denoising is fundamental to Monte Carlo rendering. Recently, real-time path-traced applications have become viable, relying heavily on efficient denoising. Modern denoisers are often based on neural networks, most commonly variants of the U-Net architecture. While tooling for development and training of custom neural networks is well established in Python, existing deployment and interop strategies typically rely on external inference frameworks, incur host synchronization, data movement, or heavyweight dependencies, making them impractical for tightly integrated, real-time rendering pipelines. We present a light-weight and portable ONNX to Vulkan conversion framework that is designed for efficient, fully GPU-resident deployment of U-Net-based networks. We employ graph-based and profile-guided optimizations to determine optimal Vulkan dispatch schedules, including block sizes, data layouts, and kernel fusion decisions. Our method includes effective pruning of the vast search space, significantly reducing compile times. Using the Open Image Denoise (OIDN) network, we demonstrate runtime improvements over established inference frameworks such as TensorRT.Keywords
This publication has 23 references indexed in Scilit:
- Simple Baselines for Image Restoration2022
- Characterizing and Demystifying the Implicit Convolution Algorithm on Commercial Matrix-Multiplication Accelerators2021
- MLIR: Scaling Compiler Infrastructure for Domain Specific Computation2021
- Tiramisu: A Polyhedral Compiler for Expressing Fast and Portable Code2019
- Denoising Deep Monte Carlo RenderingsComputer Graphics Forum, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- A graph-based higher-order intermediate representation2015
- Adaptive Rendering Based on Weighted Local RegressionACM Transactions on Graphics, 2014
- Adaptive rendering with non-local means filteringACM Transactions on Graphics, 2012
- A simple graph-based intermediate representationACM SIGPLAN Notices, 1995