Graph neural network interatomic potential ensembles with calibrated aleatoric and epistemic uncertainty on energy and forces
Open Access
- 18 September 2023
- journal article
- research article
- Published by Royal Society of Chemistry (RSC) in Physical Chemistry Chemical Physics
- Vol. 25 (37) , 25828-25837
Abstract
Inexpensive machine learning (ML) potentials are increasingly being used to speed up structural optimization and molecular dynamics simulations of materials by iteratively predicting and applying interatomic forces. In these settings, it is crucial to detect when predictions are unreliable to avoid wrong or misleading results. Here, we present a complete framework for training and recalibrating graph neural network ensemble models to produce accurate predictions of energy and forces with calibrated uncertainty estimates. The proposed method considers both epistemic and aleatoric uncertainty and the total uncertainties are recalibrated post hoc using a nonlinear scaling function to achieve good calibration on previously unseen data, without loss of predictive accuracy. The method is demonstrated and evaluated on two challenging, publicly available datasets, ANI-1x (Smith et al. J. Chem. Phys., 2018, 148, 241733.) and Transition1x (Schreiner et al. Sci. Data, 2022, 9, 779.), both containing diverse conformations far from equilibrium. A detailed analysis of the predictive performance and uncertainty calibration is provided. In all experiments, the proposed method achieved low prediction error and good uncertainty calibration, with predicted uncertainty correlating with expected error, on energy and forces. To the best of our knowledge, the method presented in this paper is the first to consider a complete framework for obtaining calibrated epistemic and aleatoric uncertainty predictions on both energy and forces in ML potentials.Keywords
All Related Versions
Funding Information
- H2020 Future and Emerging Technologies (957189, 957213)
- Novo Nordisk Fonden (NNF22OC0076658)
This publication has 18 references indexed in Scilit:
- Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methodsMachine Learning, 2021
- Retrospective on a decade of machine learning for chemical discoveryNature Communications, 2020
- Committee neural network potentials control generalization errors and enable active learningThe Journal of Chemical Physics, 2020
- Uncertainty Quantification Using Neural Networks for Molecular Property PredictionJournal of Chemical Information and Modeling, 2020
- Evaluating Scalable Uncertainty Estimation Methods for Deep Learning-Based Molecular Property PredictionJournal of Chemical Information and Modeling, 2020
- Quantum Chemistry in the Age of Machine LearningThe Journal of Physical Chemistry Letters, 2020
- Less is more: Sampling chemical space with active learningThe Journal of Chemical Physics, 2018
- Addressing uncertainty in atomistic machine learningPhysical Chemistry Chemical Physics, 2017
- Optimization methods for finding minimum energy pathsThe Journal of Chemical Physics, 2008
- Information Theory and Statistical MechanicsPhysical Review B, 1957