Sequence modeling and design from molecular to genome scale with Evo
Authors:
- Stephen A BaccusSBStephen A Baccus
Preprint
Abstract
The genome is a sequence that completely encodes the DNA, RNA, and proteins that orchestrate the function of a whole organism. Advances in machine learning combined with massive datasets of whole genomes could enable a biological foundation model that accelerates the mechanistic understanding and generative design of complex molecular interactions. We report Evo, a genomic foundation model that enables prediction and generation tasks from the molecular to genome scale. Using an architecture based on advances in deep signal processing, we scale Evo to 7 billion parameters with a context length of 131 kilobases (kb) at single-nucleotide, byte resolution. Trained on whole prokaryotic genomes, Evo can generalize across the three fundamental modalities of the central dogma of molecular biology to perform zero-shot function prediction that is competitive with, or outperforms, leading domain-specific language models. Evo also excels at multi-element generation tasks, which we demonstrate by generating synthetic CRISPR-Cas molecular complexes and entire transposable systems for the first time. Using information learned over whole genomes, Evo can also predict gene essentiality at nucleotide resolution and can generate coding-rich sequences up to 650 kb in length, orders of magnitude longer than previous methods. Advances in multi-modal and multi-scale learning with Evo provides a promising path toward improving our understanding and control of biology across multiple levels of complexity.Keywords
All Related Versions
- Published version: Science, 386 (6723), eado9336.
This publication has 103 references indexed in Scilit:
- Deep learning and CRISPR-Cas13d ortholog discovery for optimized RNA targetingCell Systems, 2023
- Direct and indirect impacts of synthetic biology on biodiversity conservationiScience, 2022
- Massive expansion of human gut bacteriophage diversityCell, 2021
- A Bioinformatic Analysis of Integrative Mobile Genetic Elements Highlights Their Role in Bacterial AdaptationCell Host & Microbe, 2020
- tRNAscan-SE: Searching for tRNA Genes in Genomic Sequences2019
- A Systematic p53 Mutation Library Links Differential Functional Impact to Cancer Mutation Pattern and Evolutionary ConservationMolecular Cell, 2018
- Evolving Better RNAfold Structure Prediction2018
- RNA Structural Determinants of Optimal Codons Revealed by MAGE-SeqCell Systems, 2016
- Development and Applications of CRISPR-Cas9 for Genome EngineeringCell, 2014
- Rapid in vivo exploration of a 5S rRNA neutral networkJournal of Microbiological Methods, 2009