MatBind: a shared embedding space for multimodal materials characterization
Authors:
- Le YangLYLe Yang
- Anoop K. ChandranACAnoop K. Chandran
- Jona ÖstreicherJÖJona Östreicher
- Evgenii SovetkinESEvgenii Sovetkin
- Adrian MirzaAMAdrian Mirza
- Sebastien BompasSBSebastien Bompas
- Bashir KazimiBKBashir Kazimi
- Pascal FriederichPFPascal Friederich
- Stefan KesselheimSKStefan Kesselheim
- Kevin Maik JablonkaKJKevin Maik Jablonka
- Stefan SandfeldSSStefan Sandfeld
Open Access
- 14 November 2026
- journal article
- Published by Springer Nature in npj Computational Materials
- Vol. 12 (1)
Abstract
Fully characterizing a crystalline material requires integrating heterogeneous data sources—atomic structures, diffraction patterns, electronic density of states, and natural language—each of which captures a different facet of the same physical object. In practice, however, these modalities are stored and analyzed in isolation, making it difficult to relate or query materials across representational boundaries. We present MatBind , a contrastive learning framework that aligns four material modalities—crystal structure, powder X-ray diffraction (pXRD) simulated from structures, density of states (DOS), and text—into a unified embedding space using crystal structure as the central physical anchor. The framework induces alignment between modalities never explicitly paired during training, enabling emergent zero-shot cross-modal retrieval as a direct consequence of the shared representation. The learned embedding space organizes materials according to physically meaningful properties without explicit supervision, and retrieval performance improves systematically when modalities are combined at query time. These results demonstrate that treating heterogeneous materials data as complementary projections of a single physical reality, rather than as isolated data sources, is not a practical choice but is consistent with the underlying physics.Funding Information
- Helmholtz Foundation Model Initiative
- NFDI consortium FAIRmat - Deutsche Forschungsgemeinschaft
This publication has 18 references indexed in Scilit:
- KAN-enhanced contrastive learning: the accelerator of crystal structure identification from XRD patternsnpj Computational Materials, 2026
- General-Purpose Models for the Chemical Sciences: LLMs and BeyondChemical Reviews, 2026
- Multi-modal contrastive learning for chemical structure elucidation with VibraCLIPDigital Discovery, 2025
- Bridging Text and Crystal Structures: Literature-driven Contrastive Learning for Materials ScienceMachine Learning: Science and Technology, 2025
- Multimodal foundation models for material property prediction and discoveryNewton, 2025
- Neural networks trained on synthetically generated crystals can extract structural information from ICSD powder X-ray diffractogramsDigital Discovery, 2023
- Quantifying the advantage of domain-specific pre-training on named entity recognition tasks in materials sciencePatterns, 2022
- Commentary: The Materials Project: A materials genome approach to accelerating materials innovationAPL Materials, 2013
- Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysisComputational Materials Science, 2013
- The Scherrer Formula for X-Ray Particle Size DeterminationPhysical Review B, 1939