Describe Molecules by a Heterogeneous Graph Neural Network with Transformer-like Attention for Supervised Property Predictions
Open Access
- 21 January 2022
- journal article
- research article
- Published by American Chemical Society (ACS) in ACS Omega
- Vol. 7 (4) , 3713-3721
Abstract
Machine learning and deep learning have facilitated various successful studies of molecular property predictions. The rapid development of natural language processing and graph neural network (GNN) further pushed the state-of-the-art prediction performance of molecular property to a new level. A geometric graph could describe a molecular structure with atoms as the nodes and bonds as the edges. Therefore, a graph neural network may be trained to better represent a molecular structure. The existing GNNs assumed homogeneous types of atoms and bonds, which may miss important information between different types of atoms or bonds. This study represented a molecule using a heterogeneous graph neural network (MolHGT), in which there were different types of nodes and different types of edges. A transformer reading function of virtual nodes was proposed to aggregate all the nodes, and a molecule graph may be represented from the hidden states of the virtual nodes. This proof-of-principle study demonstrated that the proposed MolHGT network improved the existing studies of molecular property predictions. The source code and the training/validation/test splitting details are available at https://github.com/zhangruochi/Mol-HGT.Keywords
This publication has 26 references indexed in Scilit:
- Low Data Drug Discovery with One-Shot LearningACS Central Science, 2017
- Quantum-chemical insights from deep tensor neural networksNature Communications, 2017
- Feature Selection Using Information Gain for Improved Structural-Based Alert CorrelationPLOS ONE, 2016
- Molecular graph convolutions: moving beyond fingerprintsJournal of Computer-Aided Molecular Design, 2016
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- The Inconsistency of “Optimal” Cutpoints Obtained using Two Criteria based on the Receiver Operating Characteristic CurveAmerican Journal of Epidemiology, 2006
- Perspective on “Density functional thermochemistry. III. The role of exact exchange”2000
- Quantum Monte CarloScience, 1986
- Inhomogeneous Electron GasPhysical Review B, 1973
- New Method for Calculating the One-Particle Green's Function with Application to the Electron-Gas ProblemPhysical Review B, 1965