IUPAC-GPT: an IUPAC-based large-scale molecular pre-trained model for property prediction and molecule generation
- 3 July 2025
- journal article
- research article
- Published by Springer Nature in Molecular Diversity
- Vol. 30 (2) , 1913-1921
Abstract
The international union of pure and applied chemistry (IUPAC) name nomenclature constitutes a universally recognized standard naming system for allocating names to chemical compounds and is a human-friendly, substructure molecular language. Simplified molecular input line entry system (SMILES) string is currently the most popular molecular representation language and is a computer-friendly, atomic-level molecular language. Considering the readability of IUPAC name and the advantages of SMILES string, it becomes significant to investigate the distinctions of these two molecular languages in term of molecular generation and regression/classification tasks. Thus, we have developed a chemical language model named IUPAC-GPT. Besides molecular generation, we have also incorporated the freezing of IUPAC-GPT model parameters and the attachment of trainable lightweight networks for fine-tuning regression/classification tasks. The results indicate that pre-trained IUPAC-GPT can grasp general knowledge that can be effectively transferred to downstream tasks such as molecular generation, binary classification, and property regression prediction. Furthermore, when utilizing the same configuration, IUPAC-GPT exhibited superior performance compared to the smilesGPT model in term of some property prediction tasks. Overall, transformer-like language models pretrained on IUPAC corpora emerge as promising alternatives, offering improved performance in terms of interpretability and semantic abstraction (chemical groups and modifications) when compared to models pretrained on SMILES corpora.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Diffusion-based generative drug-like molecular editing with chemical natural languageJournal of Pharmaceutical Analysis, 2024
- Transformer-Based Molecular Generative Model for Antiviral Drug DesignJournal of Chemical Information and Modeling, 2023
- GuacaMol: Benchmarking Models for de Novo Molecular DesignJournal of Chemical Information and Modeling, 2019
- Fréchet ChemNet Distance: A Metric for Generative Models for Molecules in Drug DiscoveryJournal of Chemical Information and Modeling, 2018
- Identity Mappings in Deep Residual Networks2016
- Chemical Name to Structure: OPSIN, an Open Source SolutionJournal of Chemical Information and Modeling, 2011
- Natural Product-likeness Score and Its Application for Prioritization of Compound LibrariesJournal of Chemical Information and Modeling, 2007
- Prediction of Physicochemical Parameters by Atomic ContributionsJournal of Chemical Information and Computer Sciences, 1999
- SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rulesJournal of Chemical Information and Computer Sciences, 1988
- A SYSTEM OF ORGANIC NOMENCLATURE.Journal of the American Chemical Society, 1917