On Accelerating Diffusion-Based Sampling Process via Improved Integration Approximation
Preprint
Abstract
A popular approach to sample a diffusion-based generative model is to solve an ordinary differential equation (ODE). In existing samplers, the coefficients of the ODE solvers are pre-determined by the ODE formulation, the reverse discrete timesteps, and the employed ODE methods. In this paper, we consider accelerating several popular ODE-based sampling processes (including EDM, DDIM, and DPM-Solver) by optimizing certain coefficients via improved integration approximation (IIA). We propose to minimize, for each time step, a mean squared error (MSE) function with respect to the selected coefficients. The MSE is constructed by applying the original ODE solver for a set of fine-grained timesteps, which in principle provides a more accurate integration approximation in predicting the next diffusion state. The proposed IIA technique does not require any change of a pre-trained model, and only introduces a very small computational overhead for solving a number of quadratic optimization problems. Extensive experiments show that considerably better FID scores can be achieved by using IIA-EDM, IIA-DDIM, and IIA-DPM-Solver than the original counterparts when the neural function evaluation (NFE) is small (i.e., less than 25).Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- On Suppressing Range of Adaptive Stepsizes of Adam to Improve Generalisation Performance2024
- Diffusion Models: A Comprehensive Survey of Methods and ApplicationsACM Computing Surveys, 2023
- StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets2022
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations1998
- Some methods of speeding up the convergence of iteration methodsUSSR Computational Mathematics and Mathematical Physics, 1964