Closing the Final Mile in Data-Driven Discovery: Interpreting Uncharted Celestial Sources with Large Language Models Across Multimodal Data
Preprint
- 14 November 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
For decades, astronomers have anticipated that vast data archives hold the potential for serendipitous discoveries, promising to reveal novel phenomena. However, the rapid growth of these datasets now risks outpacing our capacity for analysis, potentially burying intriguing ``known unknowns’’ and even ``unknown unknowns’’ beneath a deluge of numbers. This challenge has given rise to a data-driven research paradigm, which is aimed at uncovering potential patterns and anomalies within data that may lead to novel scientific discoveries. Although machine learning algorithms have proven highly effective in identifying patterns and anomalous candidates from these data, the critical final step of determining their physical nature from a diverse array of possibilities remains a formidable bottleneck. The sheer breadth of modern astrophysics exceeds the expertise of any individual, or any single team, especially when the focus of data-driven researchers is always directed at the data and algorithms themselves. The advent of large language models (LLMs), with their unprecedented breadth of knowledge, offers a transformative solution. In this study, we present a novel framework that leverages LLMs to interpret the nature of unusual sources. Our investigation commenced with anomalous sources identified by machine learning algorithms through the analysis of NEOWISE infrared light curves. We provided the models with both the light curves and spectral energy distributions (SEDs) of these objects, tasking them with describing the data and inferring the underlying physical nature and source type. We validated the reasonableness of the model's inferences using a curated set of well-studied rare variable sources. Subsequently, we applied the same methodology to previously unclassified sources absent from the SIMBAD database, successfully identified dozens of objects with high scientific potential and generated AI-proposed follow-up observation plans. Although the computational cost of running LLMs is often nontrivial, this framework, which focuses on a small subset of algorithmically preselected anomalies, remains computationally tractable. We argue that this methodology is not confined to time-domain and SED data but can be readily extended to other data modalities, including images and spectra, paving the way for accelerated discovery in the era of future large-scale sky surveys.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- High-resolution spectroscopy of the variable hot post-AGB star LS 4331 (IRAS 17381−1616)Journal of Astrophysics and Astronomy, 2024
- SU Lyn - a transient symbiotic starMonthly Notices of the Royal Astronomical Society, 2021
- Hen 3-860: new southern eclipsing symbiotic star observed in the outburstMonthly Notices of the Royal Astronomical Society, 2021
- V838 Monocerotis as seen by ALMA: A remnant of a binary merger in a triple systemAstronomy & Astrophysics, 2021
- Astronomaly: Personalised active anomaly detection in astronomical dataAstronomy and Computing, 2021
- Accretion disc cooling and narrow absorption lines in the tidal disruption event AT 2019dsgMonthly Notices of the Royal Astronomical Society, 2021
- Spectroscopy and Kinematics of the High-Latitude UX Ori Type Star V1117 HerAstrophysics, 2020
- An outflow powers the optical rise of the nearby, fast-evolving tidal disruption event AT2019qizMonthly Notices of the Royal Astronomical Society, 2020
- Interferometric view of the circumstellar envelopes of northern FU Orionis-type starsAstronomy & Astrophysics, 2017
- The Sixth Catalogue of galactic Wolf-Rayet stars, their past and presentSpace Science Reviews, 1981