Benchmarking the accuracy of structure‐based binding affinity predictors on Spike–ACE2 deep mutational interaction set
- 22 November 2023
- journal article
- research article
- Published by Wiley in Proteins: Structure, Function, and Bioinformatics
- Vol. 92 (4) , 529-539
Abstract
Since the start of COVID-19 pandemic, a huge effort has been devoted to understanding the Spike (SARS-CoV-2)-ACE2 recognition mechanism. To this end, two deep mutational scanning studies traced the impact of all possible mutations across receptor binding domain (RBD) of Spike and catalytic domain of human ACE2. By concentrating on the interface mutations of these experimental data, we bench marked six commonly used structure-based binding affinity predictors (FoldX, EvoEF1, MutaBind2, SSIPe, HADDOCK, and UEP). These predictors were selected based on their user-friendliness, accessibility, and speed. As a result of our bench marking efforts, we observed that none of the methods could generate a meaningful correlation with the experimental binding data. The best correlation is achieved by FoldX (R =-0.51). When we simplified the prediction problem to a binary classification, that is, whether a mutation is enriching or depleting the binding, we showed that the highest accuracy is achieved by FoldX with a 64% success rate. Surprisingly, on this set, simple energetic scoring functions performed significantly better than the ones using extra evolutionary-based terms, as in Mutabind and SSIPe. Furthermore, we demonstrated that recent AI approaches, mmCSM-PPI and TopNetTree, yielded comparable performances to the force field-based techniques. These observations suggest plenty of room to improve the binding affinity predictors in guessing the variant-induced binding profile changes of a host-pathogen system, such as Spike-ACE2. To aid such improvements we provide our benchmarking data at https://github.com/CSB-KaracaLab/RBD-ACE2-MutBench with the option to visualize our mutant models at https://rbd-ace2-mutbench.github.io/.Keywords
All Related Versions
Funding Information
- European Molecular Biology Organization (4421)
This publication has 42 references indexed in Scilit:
- Middle East respiratory syndrome coronavirus: transmission, virology and therapeutic targeting to aid in outbreak controlExperimental & Molecular Medicine, 2015
- A Smoothed Backbone-Dependent Rotamer Library for Proteins Derived from Adaptive Kernel Density Estimates and RegressionsStructure, 2011
- iAlign: a method for the structural comparison of protein–protein interfacesBioinformatics, 2010
- New descriptors of amino acids and their application to peptide QSAR studyPeptides, 2008
- Inference of Macromolecular Assemblies from Crystalline StateJournal of Molecular Biology, 2007
- The FoldX web server: an online force fieldNucleic Acids Research, 2005
- SARS, the First Pandemic of the 21st Century1Emerging Infectious Diseases, 2004
- Angiotensin-converting enzyme 2 is a functional receptor for the SARS coronavirusNature, 2003
- HADDOCK: A Protein−Protein Docking Approach Based on Biochemical or Biophysical InformationJournal of the American Chemical Society, 2003
- Gapped BLAST and PSI-BLAST: a new generation of protein database search programsNucleic Acids Research, 1997