CoCoGen: Physically Consistent and Conditioned Score-Based Generative Models for Forward and Inverse Problems
Top Cited Papers
- 1 April 2025
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Scientific Computing
- Vol. 47 (2) , C399-C425
Abstract
Recent advances in generative artificial intelligence have had a significant impact on diverse domains spanning computer vision, natural language processing, and drug discovery. This work extends the reach of generative models into physical problem domains, particularly addressing the efficient enforcement of physical laws and conditioning for forward and inverse problems involving partial differential equations (PDEs). Our work introduces two key contributions: first, we present an efficient approach to promote consistency with the underlying PDE. By incorporating discretized information into score-based generative models, our method generates samples closely aligned with the true data distribution, showcasing residuals comparable to data generated through conventional PDE solvers, significantly enhancing fidelity. Second, we showcase the potential and versatility of score-based generative models in various physics tasks, specifically highlighting surrogate modeling as well as probabilistic field reconstruction and inversion from sparse measurements. A robust foundation is laid by designing unconditional score-based generative models that utilize reversible probability flow ordinary differential equations. Leveraging conditional models that require minimal training, we illustrate their flexibility when combined with a frozen unconditional model. These conditional models generate PDE solutions by incorporating parameters, macroscopic quantities, or partial field measurements as guidance. The results illustrate the inherent flexibility of score-based generative models and explore the synergy between unconditional score-based generative models and the present physically consistent sampling approach, emphasizing the power and flexibility in solving for and inverting physical fields governed by differential equations, and in other scientific machine learning tasks. Reproducibility of computational results. This paper has been awarded the “SIAM Reproducibility Badge: Code and data available” as a recognition that the authors have followed reproducibility principles valued by SISC and the scientific computing community. Code and data that allow readers to reproduce the results in this paper are available at https://github.com/christian-jacobsen/CoCoGen and in the supplementary materials ( CoCoGen-master.zip [89.6KB], Physical_Consistency_in_Score_based_Generative_Models_Supplementary.pdf [1.07MB]). [Formula: see text]Keywords
All Related Versions
Funding Information
- Los Alamos National Laboratory
This publication has 21 references indexed in Scilit:
- A physics-informed diffusion model for high-fidelity flow field reconstructionJournal of Computational Physics, 2023
- AUC Maximization in the Era of Big Data and AI: A SurveyACM Computing Surveys, 2022
- Score-based diffusion models for accelerated MRIMedical Image Analysis, 2022
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equationsJournal of Computational Physics, 2019
- Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantificationJournal of Computational Physics, 2018
- A Connection Between Score Matching and Denoising AutoencodersNeural Computation, 2011
- Nonlinear Model Reduction via Discrete Empirical InterpolationSIAM Journal on Scientific Computing, 2010
- Representations of Knowledge in Complex SystemsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1994
- Reverse-time diffusion equation modelsStochastic Processes and their Applications, 1982
- Correlation functions and computer simulationsNuclear Physics B, 1981