Agent-based Learning of Materials Datasets from Scientific Literature
Preprint
Abstract
Advancements in machine learning and artificial intelligence are transforming materials discovery. Yet, the availability of structured experimental data remains a bottleneck. The vast corpus of scientific literature presents a valuable and rich resource of such data. However, manual dataset creation from these resources is challenging due to issues in maintaining quality and consistency, scalability limitations, and the risk of human error and bias. Therefore, in this work, we develop a chemist AI agent, powered by large language models (LLMs), to overcome these challenges by autonomously creating structured datasets from natural language text, ranging from sentences and paragraphs to extensive scientific research articles. Our chemist AI agent, Eunomia, can plan and execute actions by leveraging the existing knowledge from decades of scientific research articles, scientists, the Internet and other tools altogether. We benchmark the performance of our approach in three different information extraction tasks with various levels of complexity, including solid-state impurity doping, metal-organic framework (MOF) chemical formula, and property relations. Our results demonstrate that our zero-shot agent, with the appropriate tools, is capable of attaining performance that is either superior or comparable to the state-of-the-art fine-tuned materials information extraction methods. This approach simplifies compilation of machine learning-ready datasets for various materials discovery applications, and significantly ease the accessibility of advanced natural language processing tools for novice users in natural language. The methodology in this work is developed as an open-source software on https://github.com/AI4ChemS/Eunomia.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- The rise and potential of large language model based agents: a surveyScience China Information Sciences, 2025
- Leveraging large language models for predictive chemistryNature Machine Intelligence, 2024
- ChatGPT Chemistry Assistant for Text Mining and the Prediction of MOF SynthesisJournal of the American Chemical Society, 2023
- BatteryBERT: A Pretrained Language Model for Battery Database EnhancementJournal of Chemical Information and Modeling, 2022
- Using Machine Learning and Data Mining to Leverage Community Knowledge for the Engineering of Stable Metal–Organic FrameworksJournal of the American Chemical Society, 2021
- Named Entity Recognition and Normalization Applied to Large-Scale Information Extraction from the Materials Science LiteratureJournal of Chemical Information and Modeling, 2019
- Materials Synthesis Insights from Scientific Literature via Text Extraction and Machine LearningChemistry of Materials, 2017
- Computing stoichiometric molecular composition from crystal structuresJournal of Applied Crystallography, 2015
- Systematic modulation and enhancement of CO2 : N2 selectivity and water stability in an isoreticular series of bio-MOF-11 analoguesChemical Science, 2013
- Crystallography Open Database (COD): an open-access collection of crystal structures and platform for world-wide collaborationNucleic Acids Research, 2011