Development and rigorous validation of antimalarial predictive models using machine learning approaches
- 22 July 2019
- journal article
- research article
- Published by Taylor & Francis in SAR and QSAR in Environmental Research
- Vol. 30 (8) , 543-560
Abstract
The large collection of known and experimentally verified compounds from the ChEMBL database was used to build different classification models for predicting the antimalarial activity against Plasmodium falciparum. Four different machine learning methods, namely the support vector machine (SVM), random forest (RF), k-nearest neighbour (kNN) and XGBoost have been used for the development of models using the diverse antimalarial dataset from ChEMBL. A well-established feature selection framework was used to select the best subset from a larger pool of descriptors. Performance of the models was rigorously evaluated by evaluation of the applicability domain, Y-scrambling and AUC-ROC curve. Additionally, the predictive power of the models was also assessed using probability calibration and predictiveness curves. SVM and XGBoost showed the best performances, yielding an accuracy of ~85% on the independent test set. In term of probability prediction, SVM and XGBoost were well calibrated. Total gain (TG) from the predictiveness curve was more related to SVM (TG = 0.67) and XGBoost (TG = 0.75). These models also predict the high-affinity compounds from PubChem antimalarial bioassay (as external validation) with a high probability score. Our findings suggest that the selected models are robust and can be potentially useful for facilitating the discovery of antimalarial agents.Keywords
This publication has 44 references indexed in Scilit:
- Hit Identification and Optimization in Virtual Screening: Practical Recommendations Based on a Critical Literature AnalysisJournal of Medicinal Chemistry, 2013
- Essentials of the self-organizing mapNeural Networks, 2013
- Adaptation of High-Throughput Screening in Drug Discovery—Toxicological Screening TestsInternational Journal of Molecular Sciences, 2011
- ChEMBL: a large-scale bioactivity database for drug discoveryNucleic Acids Research, 2011
- Artemisinin Resistance inPlasmodium falciparumMalariaNew England Journal of Medicine, 2009
- Integrating the Predictiveness of a Marker with Its Performance as a ClassifierAmerican Journal of Epidemiology, 2007
- Evaluating the Predictiveness of a Continuous MarkerBiometrics, 2007
- The use of the area under the ROC curve in the evaluation of machine learning algorithmsPattern Recognition, 1997
- Education reforms struggle against apartheid's legacyNature, 1996
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982