An effective self-supervised framework for learning expressive molecular global representations to drug discovery
- 3 May 2021
- journal article
- research article
- Published by Oxford University Press (OUP) in Briefings in Bioinformatics
- Vol. 22 (6)
Abstract
How to produce expressive molecular representations is a fundamental challenge in artificial intelligence-driven drug discovery. Graph neural network (GNN) has emerged as a powerful technique for modeling molecular data. However, previous supervised approaches usually suffer from the scarcity of labeled data and poor generalization capability. Here, we propose a novel molecular pre-training graph-based deep learning framework, named MPG, that learns molecular representations from large-scale unlabeled molecules. In MPG, we proposed a powerful GNN for modelling molecular graph named MolGNet, and designed an effective self-supervised strategy for pre-training the model at both the node and graph-level. After pre-training on 11 million unlabeled molecules, we revealed that MolGNet can capture valuable chemical insights to produce interpretable representation. The pre-trained MolGNet can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of drug discovery tasks, including molecular properties prediction, drug-drug interaction and drug-target interaction, on 14 benchmark datasets. The pre-trained MolGNet in MPG has the potential to become an advanced molecular encoder in the drug discovery pipeline.Keywords
Funding Information
- Department of Education Key Innovation Research
- institute guoqiang at tsinghua university
- National Natural Science Foundation of China (61836004)
- Beijing Brain Science Special Project (Z181100001518006)
This publication has 33 references indexed in Scilit:
- ZINC 15 – Ligand Discovery for EveryoneJournal of Chemical Information and Modeling, 2015
- Similarity-based modeling in large-scale prediction of drug-drug interactionsNature Protocols, 2014
- Drug–target interaction prediction via chemogenomic space: learning-based methodsExpert Opinion on Drug Metabolism & Toxicology, 2014
- Computational Methods in Drug DiscoveryPharmacological Reviews, 2014
- QSAR Modeling: Where Have You Been? Where Are You Going To?Journal of Medicinal Chemistry, 2013
- Metabolite identification and molecular fingerprint prediction through machine learningBioinformatics, 2012
- ChEMBL: a large-scale bioactivity database for drug discoveryNucleic Acids Research, 2011
- Extended-Connectivity FingerprintsJournal of Chemical Information and Modeling, 2010
- Computer-aided drug discovery and development (CADDD): In silico-chemico-biological approachChemico-Biological Interactions, 2008
- SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rulesJournal of Chemical Information and Computer Sciences, 1988