A Periodic Bayesian Flow for Material Generation
Preprint
Abstract
Generative modeling of crystal data distribution is an important yet challenging task due to the unique periodic physical symmetry of crystals. Diffusion-based methods have shown early promise in modeling crystal distribution. More recently, Bayesian Flow Networks were introduced to aggregate noisy latent variables, resulting in a variance-reduced parameter space that has been shown to be advantageous for modeling Euclidean data distributions with structural constraints (Song et al., 2023). Inspired by this, we seek to unlock its potential for modeling variables located in non-Euclidean manifolds e.g. those within crystal structures, by overcoming challenging theoretical issues. We introduce CrysBFN, a novel crystal generation method by proposing a periodic Bayesian flow, which essentially differs from the original Gaussian-based BFN by exhibiting non-monotonic entropy dynamics. To successfully realize the concept of periodic Bayesian flow, CrysBFN integrates a new entropy conditioning mechanism and empirically demonstrates its significance compared to time-conditioning. Extensive experiments over both crystal ab initio generation and crystal structure prediction tasks demonstrate the superiority of CrysBFN, which consistently achieves new state-of-the-art on all benchmarks. Surprisingly, we found that CrysBFN enjoys a significant improvement in sampling efficiency, e.g., ~100x speedup 10 v.s. 2000 steps network forwards) compared with previous diffusion-based methods on MP-20 dataset. Code is available at https://github.com/wu-han-lin/CrysBFN.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Space group informed transformer for crystalline materials generationScience Bulletin, 2025
- Crystal structure prediction with machine learning-based element substitutionComputational Materials Science, 2022
- An invertible crystallographic representation for general inverse design of inorganic crystals with targeted propertiesMatter, 2022
- PyXtal: A Python library for crystal structure generation and symmetry analysisComputer Physics Communications, 2021
- Inverse Design of Solid-State Materials via a Continuous RepresentationMatter, 2019
- Graph Networks as a Universal Machine Learning Framework for Molecules and CrystalsChemistry of Materials, 2019
- Materials discovery and design using machine learningJournal of Materiomics, 2017
- ChemInform Abstract: Ab-initio Simulations of Materials Using VASP: Density-functional Theory and BeyondChemInform, 2008
- USPEX—Evolutionary crystal structure predictionComputer Physics Communications, 2006
- Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis setComputational Materials Science, 1996