Equi-mRNA: Protein Translation Equivariant Encoding for mRNA Language Models
Preprint
Abstract
The growing importance of mRNA therapeutics and synthetic biology highlights the need for models that capture the latent structure of synonymous codon (different triplets encoding the same amino acid) usage, which subtly modulates translation efficiency and gene expression. While recent efforts incorporate codon-level inductive biases through auxiliary objectives, they often fall short of explicitly modeling the structured relationships that arise from the genetic code's inherent symmetries. We introduce Equi-mRNA, the first codon-level equivariant mRNA language model that explicitly encodes synonymous codon symmetries as cyclic subgroups of 2D Special Orthogonal matrix (SO(2)). By combining group-theoretic priors with an auxiliary equivariance loss and symmetry-aware pooling, Equi-mRNA learns biologically grounded representations that outperform vanilla baselines across multiple axes. On downstream property-prediction tasks including expression, stability, and riboswitch switching Equi-mRNA delivers up to approximately 10% improvements in accuracy. In sequence generation, it produces mRNA constructs that are up to approximately 4x more realistic under Frechet BioDistance metrics and approximately 28% better preserve functional properties compared to vanilla baseline. Interpretability analyses further reveal that learned codon-rotation distributions recapitulate known GC-content biases and tRNA abundance patterns, offering novel insights into codon usage. Equi-mRNA establishes a new biologically principled paradigm for mRNA modeling, with significant implications for the design of next-generation therapeutics.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Codon language embeddings provide strong signals for use in protein engineeringNature Machine Intelligence, 2024
- Algorithm for optimized mRNA design improves stability and immunogenicityNature, 2023
- ProtGPT2 is a deep unsupervised language model for protein designNature Communications, 2022
- MPEPE, a predictive approach to improve protein expression in E. coli based on deep learningComputational and Structural Biotechnology Journal, 2022
- Tuning the Performance of Synthetic Riboswitches using Machine LearningACS Synthetic Biology, 2018
- Synonymous Codons Direct Cotranslational Folding toward Different Protein ConformationsMolecular Cell, 2016
- Predicting effects of noncoding variants with deep learning–based sequence modelNature Methods, 2015
- mRNA-based therapeutics — developing a new class of drugsNature Reviews Drug Discovery, 2014
- Synonymous but not the same: the causes and consequences of codon biasNature Reviews Genetics, 2010
- Correlation between the abundance of Escherichia coli transfer RNAs and the occurrence of the respective codons in its protein genes: A proposal for a synonymous codon choice that is optimal for the E. coli translational systemJournal of Molecular Biology, 1981