Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling
Preprint
Abstract
Accurate predictions and uncertainty quantification (UQ) are essential for decision-making in risk-sensitive fields such as system safety modeling. Deep ensembles (DEs) are efficient and scalable methods for UQ in Deep Neural Networks (DNNs); however, their performance is limited when constructed by simply retraining the same DNN multiple times with randomly sampled initializations. To overcome this limitation, we propose a novel method that combines Bayesian optimization (BO) with DE, referred to as BODE, to enhance both predictive accuracy and UQ. We apply BODE to a case study involving a Densely connected Convolutional Neural Network (DCNN) trained on computational fluid dynamics (CFD) data to predict eddy viscosity in sodium fast reactor thermal stratification modeling. Compared to a manually tuned baseline ensemble, BODE estimates total uncertainty approximately four times lower in a noise-free environment, primarily due to the baseline's overestimation of aleatoric uncertainty. Specifically, BODE estimates aleatoric uncertainty close to zero, while aleatoric uncertainty dominates the total uncertainty in the baseline ensemble. We also observe a reduction of more than 30% in epistemic uncertainty. When Gaussian noise with standard deviations of 5% and 10% is introduced into the data, BODE accurately fits the data and estimates uncertainty that aligns with the data noise. These results demonstrate that BODE effectively reduces uncertainty and enhances predictions in data-driven models, making it a flexible approach for various applications requiring accurate predictions and robust UQ.Keywords
All Related Versions
This publication has 50 references indexed in Scilit:
- Predicting critical heat flux with uncertainty quantification and domain generalization using conditional variational autoencoders and deep neural networksAnnals of Nuclear Energy, 2025
- Benchmarking FFTF LOFWOS Test# 13 using SAM code: Baseline model development and uncertainty quantificationAnnals of Nuclear Energy, 2023
- Parameter identification and state estimation for nuclear reactor operation digital twinAnnals of Nuclear Energy, 2022
- Uncertainty quantification and software risk analysis for digital twins in the nearly autonomous management and control systems: A reviewAnnals of Nuclear Energy, 2021
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methodsMachine Learning, 2021
- Using deep learning to explore local physical similarity for global-scale bridging in thermal-hydraulic simulationAnnals of Nuclear Energy, 2020
- Application of convolutional neural networks featuring Bayesian optimization for landslide susceptibility assessmentCATENA, 2020
- On the prediction of critical heat flux using a physics-informed machine learning-aided frameworkApplied Thermal Engineering, 2020
- Data-driven modeling for boiling heat transfer: Using deep neural networks and high-fidelity simulation resultsApplied Thermal Engineering, 2018
- Safe reactor depressurization windows for BWR Mark I Station Blackout accident management strategyAnnals of Nuclear Energy, 2018