Protriever: End-to-End Differentiable Protein Homology Search for Fitness Prediction
Preprint
Abstract
Retrieving homologous protein sequences is essential for a broad range of protein modeling tasks such as fitness prediction, protein design, structure modeling, and protein-protein interactions. Traditional workflows have relied on a two-step process: first retrieving homologs via Multiple Sequence Alignments (MSA), then training models on one or more of these alignments. However, MSA-based retrieval is computationally expensive, struggles with highly divergent sequences or complex insertions & deletions patterns, and operates independently of the downstream modeling objective. We introduce Protriever, an end-to-end differentiable framework that learns to retrieve relevant homologs while simultaneously training for the target task. When applied to protein fitness prediction, Protriever achieves state-of-the-art performance compared to sequence-based models that rely on MSA-based homolog retrieval, while being two orders of magnitude faster through efficient vector search. Protriever is both architecture- and task-agnostic, and can flexibly adapt to different retrieval strategies and protein databases at inference time -- offering a scalable alternative to alignment-centric approaches.Keywords
All Related Versions
This publication has 51 references indexed in Scilit:
- ProGen2: Exploring the boundaries of protein language modelsCell Systems, 2023
- Deep Mutational Scanning of SARS-CoV-2 Receptor Binding Domain Reveals Constraints on Folding and ACE2 BindingCell, 2020
- MMseqs2 enables sensitive protein sequence searching for the analysis of massive data setsNature Biotechnology, 2017
- Mutation effects predicted from sequence co-variationNature Biotechnology, 2017
- A Comprehensive Biophysical Description of Pairwise Epistasis throughout an Entire Protein DomainCurrent Biology, 2014
- Analyses of the Effects of All Ubiquitin Point Mutants on Yeast Growth RateJournal of Molecular Biology, 2013
- The spatial architecture of protein function and adaptationNature, 2012
- An introduction to hidden Markov models for biological sequences1998
- Correlated mutations and residue contacts in proteinsProteins: Structure, Function, and Bioinformatics, 1994
- Basic local alignment search toolJournal of Molecular Biology, 1990