MultiModal-Learning for Predicting Molecular Properties: A Framework Based on Image and Graph Structures
Preprint
Abstract
The quest for accurate prediction of drug molecule properties poses a fundamental challenge in the realm of Artificial Intelligence Drug Discovery (AIDD). An effective representation of drug molecules emerges as a pivotal component in this pursuit. Contemporary leading-edge research predominantly resorts to self-supervised learning (SSL) techniques to extract meaningful structural representations from large-scale, unlabeled molecular data, subsequently fine-tuning these representations for an array of downstream tasks. However, an inherent shortcoming of these studies lies in their singular reliance on one modality of molecular information, such as molecule image or SMILES representations, thus neglecting the potential complementarity of various molecular modalities. In response to this limitation, we propose MolIG, a novel MultiModaL molecular pre-training framework for predicting molecular properties based on Image and Graph structures. MolIG model innovatively leverages the coherence and correlation between molecule graph and molecule image to execute self-supervised tasks, effectively amalgamating the strengths of both molecular representation forms. This holistic approach allows for the capture of pivotal molecular structural characteristics and high-level semantic information. Upon completion of pre-training, Graph Neural Network (GNN) Encoder is used for the prediction of downstream tasks. In comparison to advanced baseline models, MolIG exhibits enhanced performance in downstream tasks pertaining to molecular property prediction within benchmark groups such as MoleculeNet Benchmark Group and ADMET Benchmark Group.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Multi-modal molecule structure–text model for text-based retrieval and editingNature Machine Intelligence, 2023
- FG-BERT: a generalized and self-supervised functional group-based molecular representation learning framework for properties predictionBriefings in Bioinformatics, 2023
- Knowledge graph-enhanced molecular contrastive learning with functional promptNature Machine Intelligence, 2023
- Molecular contrastive learning of representations via graph neural networksNature Machine Intelligence, 2022
- Molecular image-convolutional neural network (CNN) assisted QSAR models for predicting contaminant reactivity toward OH radicals: Transfer learning, data augmentation and model interpretationChemical Engineering Journal, 2021
- Molecular image-based convolutional neural network for the prediction of ADMET propertiesChemometrics and Intelligent Laboratory Systems, 2019
- Pushing the Boundaries of Molecular Representation for Drug Discovery with the Graph Attention MechanismJournal of Medicinal Chemistry, 2019
- PubChem 2019 update: improved access to chemical dataNucleic Acids Research, 2018
- The rise of deep learning in drug discoveryDrug Discovery Today, 2018
- MoleculeNet: a benchmark for molecular machine learningChemical Science, 2017