ATOM-1: A Foundation Model for RNA Structure and Function Built on Chemical Mapping Data
Preprint
Abstract
RNA-based medicines and RNA-targeting drugs are emerging as promising new approaches for treating disease. Optimizing these therapeutics by naive experimental screening is a time-consuming and expensive process, while rational design requires an accurate understanding of the structure and function of RNA. To address this design challenge, we present ATOM-1, the first RNA foundation model trained on chemical mapping data, enabled by data collection strategies purposely developed for machine learning training. Using small probe neural networks on top of ATOM-1 embeddings, we demonstrate that this model has developed rich internal representations of RNA. Trained on limited amounts of additional data, these small networks achieve state-of-the-art accuracy on key RNA prediction tasks, suggesting that this approach can enable the design of therapies across the RNA landscape.Keywords
This publication has 35 references indexed in Scilit:
- Author response for "Assessment of three‐dimensional RNA structure prediction in CASP15"2023
- Contemporary Progress and Opportunities in RNA-Targeted Drug DiscoveryACS Medicinal Chemistry Letters, 2023
- Thirteen dubious ways to detect conserved structural RNAsIUBMB Life, 2022
- RNA therapeutics in the clinicBioengineering & Translational Medicine, 2022
- Antisense technology: A reviewJournal of Biological Chemistry, 2021
- How to benchmark RNA secondary structure prediction accuracyMethods, 2019
- MMseqs2 enables sensitive protein sequence searching for the analysis of massive data setsNature Biotechnology, 2017
- RNA motif discovery by SHAPE and mutational profiling (SHAPE-MaP)Nature Methods, 2014
- Methods of Protein Structure Comparison2011
- RNA Structure Analysis at Single Nucleotide Resolution by Selective 2‘-Hydroxyl Acylation and Primer Extension (SHAPE)Journal of the American Chemical Society, 2005