Consensus Modeling Strategies for Predicting Transthyretin Binding Affinity from Tox24 Challenge Data
Open Access
- 15 May 2025
- journal article
- Published by American Chemical Society (ACS) in Chemical Research in Toxicology
- Vol. 38 (6) , 1061-1071
Abstract
Transthyretin (TTR) is a key transporter of the thyroid hormone thyroxine, and chemicals that bind to TTR, displacing the hormone, can disrupt the endocrine system, even at low concentrations. This study evaluates computational modeling strategies developed during the Tox24 Challenge, using a data set of 1512 compounds tested for TTR binding affinity. Individual models from nine top-performing teams were analyzed for performance and uncertainty using regression metrics and applicability domains (AD). Consensus models were developed by averaging predictions across these models, with and without consideration of their ADs. While applying AD constraints in individual models generally improved external prediction accuracy (at the expense of reduced chemical space coverage), it had limited additional benefit for consensus models. Results showed that consensus models outperformed individual models, achieving a root-mean-square error (RMSE) of 19.8% on the test set, compared to an average RMSE of 20.9% for the nine individual models. Outliers consistently identified in several of these models indicate potential experimental artifacts and/or activity cliffs, requiring further investigation. Substructure importance analysis revealed that models prioritized different chemical features, and consensus averaging harmonized these divergent perspectives. These findings highlight the value of consensus modeling in improving predictive performance and addressing model limitations. Future work should focus on expanding chemical space coverage and refining experimental data sets to support public health protection.Keywords
Funding Information
- National Center for Advancing Translational Sciences
- HORIZON EUROPE Marie Sklodowska-Curie Actions (101120466)
- State Committee of Science (23LCG-1F002)
This publication has 52 references indexed in Scilit:
- Machine learning models for phase transition and decomposition temperature of ionic liquidsJournal of Molecular Liquids, 2022
- Graph neural networks in TensorFlow-Keras with RaggedTensor representation (kgcnn)Software Impacts, 2021
- New approach methods for testing chemicals for endocrine disruption potentialCurrent Opinion in Toxicology, 2018
- Identifying potential endocrine disruptors among industrial chemicals and their metabolites – development and evaluation of in silico toolsChemosphere, 2015
- Prediction of binding affinity and efficacy of thyroid hormone receptor ligands using QSAR and structure-based modeling methodsToxicology and Applied Pharmacology, 2014
- Modeling the Biodegradability of Chemical Compounds Using the Online CHEmical Modeling Environment (OCHEM)Molecular Informatics, 2013
- Predictive QSAR Modeling: Methods and Applications in Drug Discovery and Chemical Risk Assessment2012
- Online chemical modeling environment (OCHEM): web platform for data storage, model development and publishing of chemical informationJournal of Computer-Aided Molecular Design, 2011
- PaDEL‐descriptor: An open source software to calculate molecular descriptors and fingerprintsJournal of Computational Chemistry, 2010
- Stacked generalizationNeural Networks, 1992