Results of the Protein Engineering Tournament: An Open Science Benchmark for Protein Modeling and Design
Authors:
- Chase ArmerCAChase Armer
- Hassan KaneHKHassan Kane
- Dana L. CortadeDCDana L. Cortade
- Henning RedestigHRHenning Redestig
- David A. EstellDEDavid A. Estell
- Adil YusufAYAdil Yusuf
- Nathan RollinsNRNathan Rollins
- Hansen SpinnerHSHansen Spinner
- Debora MarksDMDebora Marks
- Tj BrunetteTBTj Brunette
- Erika DeBenedictisEDErika DeBenedictis
Preprint
Abstract
The grand challenge of protein engineering is the development of computational models to characterize and generate protein sequences for arbitrary functions. Progress is limited by lack of 1) benchmarking opportunities, 2) large protein function datasets, and 3) access to experimental protein characterization. We introduce the Protein Engineering Tournament—a fully-remote competition designed to foster the development and evaluation of computational approaches in protein engineering. The tournament consists of an in silico round, predicting biophysical properties from protein sequences, followed by an in vitro round where novel protein sequences are designed, expressed and characterized using automated methods. Upon completion, all datasets, experimental protocols, and methods are made publicly available. We detail the structure and outcomes of a pilot Tournament involving seven protein design teams, powered by six multi-objective datasets, with experimental characterization by our partner, International Flavors and Fragrances. Forthcoming Protein Engineering Tournaments aim to mobilize the scientific community towards transparent evaluation of progress in the field. GraphicalKeywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Results of the Protein Engineering Tournament: An Open Science Benchmark for Protein Modeling and DesignbioRxiv, 2024
- ProteinGym: Large-Scale Benchmarks for Protein Design and Fitness PredictionbioRxiv, 2023
- CACHE (Critical Assessment of Computational Hit-finding Experiments): A public–private partnership benchmarking initiative to enable the development of computational methods for hit-findingNature Reviews Chemistry, 2022
- Adaptive machine learning for protein engineeringCurrent Opinion in Structural Biology, 2022
- Deep generative modeling for protein designCurrent Opinion in Structural Biology, 2022
- AlphaFold Protein Structure Database: massively expanding the structural coverage of protein-sequence space with high-accuracy modelsNucleic Acids Research, 2021
- FLIP: Benchmark tasks in fitness landscape inference for proteinsbioRxiv, 2021
- ProtaBank: A repository for protein design and engineering dataProtein Science, 2018
- PyRosetta: a script-based interface for implementing molecular modeling algorithms using RosettaBioinformatics, 2010
- A large‐scale experiment to assess protein structure prediction methodsProteins: Structure, Function, and Bioinformatics, 1995