Estimation of model accuracy in CASP15 using the ModFOLDdock server
Open Access
- 14 June 2023
- journal article
- research article
- Published by Wiley in Proteins: Structure, Function, and Bioinformatics
- Vol. 91 (12) , 1871-1878
Abstract
In CASP15, there was a greater emphasis on multimeric modeling than in previous experiments, with assembly structures nearly doubling in number (41 up from 22) since the previous round. CASP15 also included a new estimation of model accuracy (EMA) category in recognition of the importance of objective quality assessment (QA) for quaternary structure models. ModFOLDdock is a multimeric model QA server developed by the McGuffin group at the University of Reading, which brings together a range of single‐model, clustering, and deep learning methods to form a consensus of approaches. For CASP15, three variants of ModFOLDdock were developed to optimize for the different facets of the quality estimation problem. The standard ModFOLDdock variant produced predicted scores optimized for positive linear correlations with the observed scores. The ModFOLDdockR variant produced predicted scores optimized for ranking, that is, the top‐ranked models have the highest accuracy. In addition, the ModFOLDdockS variant used a quasi‐single model approach to score each model on an individual basis. The scores from all three variants achieved strongly positive Pearson correlation coefficients with the CASP observed scores (oligo‐lDDT) in excess of 0.70, which were maintained across both homomeric and heteromeric model populations. In addition, at least one of the ModFOLDdock variants was consistently ranked in the top two methods across all three EMA categories. Specifically, for overall global fold prediction accuracy, ModFOLDdock placed second and ModFOLDdockR placed third; for overall interface quality prediction accuracy, ModFOLDdockR, ModFOLDdock, and ModFOLDdockS were placed above all other predictor methods, and ModFOLDdockR and ModFOLDdockS were placed second and third respectively for individual residue confidence scores. The ModFOLDdock server is available at: https://www.reading.ac.uk/bioinf/ModFOLDdock/. ModFOLDdock is also available as part of the MultiFOLD docker package: https://hub.docker.com/r/mcguffin/multifold.Keywords
All Related Versions
Funding Information
- Biotechnology and Biological Sciences Research Council
- Saudi Arabian Cultural Bureau
- Biotechnology and Biological Sciences Research Council (BB/T018496/1)
This publication has 19 references indexed in Scilit:
- ModFOLD8: accurate global and local quality estimates for 3D protein modelsNucleic Acids Research, 2021
- Modeling protein quaternary structure of homo- and hetero-oligomers beyond binary interactions by homologyScientific Reports, 2017
- Accurate template‐based modeling in CASP12 using the IntFOLD4‐TS, ModFOLD6, and ReFOLD methodsProteins: Structure, Function, and Bioinformatics, 2017
- ModFOLD6: an accurate web server for the global and local quality estimation of 3D protein modelsNucleic Acids Research, 2017
- DockQ: A Quality Measure for Protein-Protein Docking ModelsPLOS ONE, 2016
- Voronota: A fast and reliable tool for computing the vertices of the Voronoi diagram of atomic ballsJournal of Computational Chemistry, 2014
- lDDT: a local superposition-free score for comparing protein structures and models using distance difference testsBioinformatics, 2013
- OpenStructure: an integrated software framework for computational structural biologyActa Crystallographica Section D Structural Biology, 2013
- MM-align: a quick algorithm for aligning multiple-chain protein complex structures using iterative dynamic programmingNucleic Acids Research, 2009
- Docking and scoring protein complexes: CAPRI 3rd EditionProteins: Structure, Function, and Bioinformatics, 2007