Blind prediction of cyclohexane–water distribution coefficients from the SAMPL5 challenge
Open Access
- 27 September 2016
- journal article
- research article
- Published by Springer Nature in Journal of Computer-Aided Molecular Design
- Vol. 30 (11) , 927-944
Abstract
In the recent SAMPL5 challenge, participants submitted predictions for cyclohexane/water distribution coefficients for a set of 53 small molecules. Distribution coefficients (log D) replace the hydration free energies that were a central part of the past five SAMPL challenges. A wide variety of computational methods were represented by the 76 submissions from 18 participating groups. Here, we analyze submissions by a variety of error metrics and provide details for a number of reference calculations we performed. As in the SAMPL4 challenge, we assessed the ability of participants to evaluate not just their statistical uncertainty, but their model uncertainty—how well they can predict the magnitude of their model or force field error for specific predictions. Unfortunately, this remains an area where prediction and analysis need improvement. In SAMPL4 the top performing submissions achieved a root-mean-squared error (RMSE) around 1.5 kcal/mol. If we anticipate accuracy in log D predictions to be similar to the hydration free energy predictions in SAMPL4, the expected error here would be around 1.54 log units. Only a few submissions had an RMSE below 2.5 log units in their predicted log D values. However, distribution coefficients introduced complexities not present in past SAMPL challenges, including tautomer enumeration, that are likely to be important in predicting biomolecular properties of interest to drug discovery, therefore some decrease in accuracy would be expected. Overall, the SAMPL5 distribution coefficient challenge provided great insight into the importance of modeling a variety of physical effects. We believe these types of measurements will be a promising source of data for future blind challenges, especially in view of the relatively straightforward nature of the experiments and the level of insight provided.Keywords
Funding Information
- National Institute of General Medical Sciences (1R01GM108889-01, U01 GM111528)
- National Science Foundation (CHE 1352608)
This publication has 56 references indexed in Scilit:
- GROMACS 4.5: a high-throughput and highly parallel open source molecular simulation toolkitBioinformatics, 2013
- Alchemical prediction of hydration free energies for SAMPLJournal of Computer-Aided Molecular Design, 2011
- Predictions of Hydration Free Energies from All-Atom Molecular Dynamics SimulationsThe Journal of Physical Chemistry B, 2009
- GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular SimulationJournal of Chemical Theory and Computation, 2008
- GROMACS: Fast, flexible, and freeJournal of Computational Chemistry, 2005
- Development and testing of a general amber force fieldJournal of Computational Chemistry, 2004
- Fast, efficient generation of high‐quality atomic charges. AM1‐BCC model: II. Parameterization and validationJournal of Computational Chemistry, 2002
- VMD: Visual molecular dynamicsJournal of Molecular Graphics, 1996
- GROMACS: A message-passing parallel molecular dynamics implementationComputer Physics Communications, 1995
- Comparison of simple potential functions for simulating liquid waterThe Journal of Chemical Physics, 1983