The Protein Engineering Tournament: An Open Science Benchmark for Protein Modeling and Design
Preprint
Abstract
The grand challenge of protein engineering is the development of computational models that can characterize and generate protein sequences for any arbitrary function. However, progress today is limited by lack of 1) benchmarks with which to compare computational techniques, 2) large datasets of protein function, and 3) democratized access to experimental protein characterization. Here, we introduce the Protein Engineering Tournament, a fully-remote, biennial competition for the development and benchmarking of computational methods in protein engineering. The tournament consists of two rounds: a first in silico round, where participants use computational models to predict biophysical properties for a set of protein sequences, and a second in vitro round, where participants are challenged to design new protein sequences, which are experimentally measured with open-source, automated methods to determine a winner. At the Tournament's conclusion, the experimental protocols and all collected data will be open-sourced for continued benchmarking and advancement of computational models. We hope the Protein Engineering Tournament will provide a transparent platform with which to evaluate progress in this field and mobilize the scientific community to conquer the grand challenge of computational protein engineering.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- CACHE (Critical Assessment of Computational Hit-finding Experiments): A public–private partnership benchmarking initiative to enable the development of computational methods for hit-findingNature Reviews Chemistry, 2022
- Adaptive machine learning for protein engineeringCurrent Opinion in Structural Biology, 2022
- Deep generative modeling for protein designCurrent Opinion in Structural Biology, 2022
- Recent advances in the discovery, characterization, and engineering of poly(ethylene terephthalate) (PET) hydrolasesEnzyme and Microbial Technology, 2021
- ProtaBank: A repository for protein design and engineering dataProtein Science, 2019
- Demonstration Results of Enzyme-Accelerated CO2 CaptureEnergy Procedia, 2017
- Engineering Antibodies for the Treatment of Infectious Diseases2017
- The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]IEEE Signal Processing Magazine, 2012
- Engineering the third wave of biocatalysisNature, 2012
- A large‐scale experiment to assess protein structure prediction methodsProteins: Structure, Function, and Bioinformatics, 1995