Applications of Modular Co-Design for De Novo 3D Molecule Generation
Preprint
Abstract
De novo 3D molecule generation is a pivotal task in drug discovery. However, many recent geometric generative models struggle to produce high-quality 3D structures, even if they maintain 2D validity and topological stability. To tackle this issue and enhance the learning of effective molecular generation dynamics, we present Megalodon-a family of scalable transformer models. These models are enhanced with basic equivariant layers and trained using a joint continuous and discrete denoising co-design objective. We assess Megalodon's performance on established molecule generation benchmarks and introduce new 3D structure benchmarks that evaluate a model's capability to generate realistic molecular structures, particularly focusing on energetics. We show that Megalodon achieves state-of-the-art results in 3D molecule generation, conditional structure generation, and structure energy benchmarks using diffusion and flow matching. Furthermore, doubling the number of parameters in Megalodon to 40M significantly enhances its performance, generating up to 49x more valid large molecules and achieving energy levels that are 2-10x lower than those of the best prior generative models.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Structure-based drug design with equivariant diffusion modelsNature Computational Science, 2024
- SiT: Exploring Flow and Diffusion-Based Generative Models with Scalable Interpolant Transformers2024
- Accurate structure prediction of biomolecular interactions with AlphaFold 3Nature, 2024
- CREST—A program for the exploration of low-energy molecular chemical spaceThe Journal of Chemical Physics, 2024
- Scalable Diffusion Models with Transformers2023
- MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation2023
- GEOM, energy-annotated molecular conformations for property prediction and molecular generationScientific Data, 2022
- PROTAC targeted protein degraders: the past is prologueNature Reviews Drug Discovery, 2022
- GFN2-xTB—An Accurate and Broadly Parametrized Self-Consistent Tight-Binding Quantum Chemical Method with Multipole Electrostatics and Density-Dependent Dispersion ContributionsJournal of Chemical Theory and Computation, 2019
- Automatic Chemical Design Using a Data-Driven Continuous Representation of MoleculesACS Central Science, 2018