SELFormerMM: multimodal molecular representation learning via SELFIES, structure, text, and knowledge graph integration
Preprint
Abstract
Motivation: Molecular representation learning is central to computational drug discovery. However, most existing models rely on single-modality inputs, such as molecular sequences or graphs, which capture only limited aspects of molecular behaviour. Yet unifying these modalities with complementary resources such as textual descriptions and biological interaction networks into a coherent multimodal framework remains non-trivial, hindering more informative and biologically grounded representations. Results: We introduce SELFormerMM, a multimodal molecular representation learning framework that integrates SELFIES notations with structural graphs, textual descriptions, and knowledge graph– derived biological interaction data. By aligning these heterogeneous views, SELFormerMM effectively captures complementary signals that unimodal approaches often overlook. Our performance evaluation has revealed that SELFormerMM outperforms structure-, sequence-, and knowledge-based models on multiple molecular property prediction tasks. Ablation analyses further indicate that effective cross-modal alignment and modality coverage improve the model’s ability to exploit complementary information. Overall, integrating SELFIES with structural, textual, and biological context enables richer molecular representations and provides a promising framework for hypothesis-driven drug discovery. Availability: SELFormerMM is available as a programmatic tool, together with datasets, pretrained models, and precomputed embeddings at https://github.com/HUBioDataLab/SELFormerMM . Contact: tuncadogan@gmail.comKeywords
This publication has 30 references indexed in Scilit:
- Self-Supervised Contrastive Molecular Representation Learning with a Chemical Synthesis Knowledge GraphJournal of Chemical Information and Modeling, 2024
- GIT-Mol: A multi-modal large language model for molecular science with graph, image, and textComputers in Biology and Medicine, 2024
- Chemprop: A Machine Learning Package for Chemical Property PredictionJournal of Chemical Information and Modeling, 2023
- Multi-modal molecule structure–text model for text-based retrieval and editingNature Machine Intelligence, 2023
- Regression Transformer enables concurrent sequence regression and generation for molecular language modellingNature Machine Intelligence, 2023
- Molecular contrastive learning of representations via graph neural networksNature Machine Intelligence, 2022
- Geometry-enhanced molecular representation learning for property predictionNature Machine Intelligence, 2022
- OnionNet: a Multiple-Layer Intermolecular-Contact-Based Convolutional Neural Network for Protein–Ligand Binding Affinity PredictionACS Omega, 2019
- Analyzing Learned Molecular Representations for Property PredictionJournal of Chemical Information and Modeling, 2019
- Potential adverse effects of amphetamine treatment on brain and behavior: a reviewMolecular Psychiatry, 2008