FALCO: towards Foundation model of Astronomical Light Curves for time dOmain astronomy

Authors:

Abstract
Time domain astronomy confronts challenges in the rapid identification and characterisation of diverse transients and variables within large-scale surveys, demanding efficient computational methods beyond conventional task-specific approaches. We propose FALCO - Foundation model of Astronomical Light Curves for time dOmain astronomy - to address the challenges by establishing generalisable representations of light curve data through self-supervised learning. Initial implementation of the model employs a modified GPT-2 architecture trained on Kepler light curves via a prediction task. Evaluations across stellar surface gravity inference, variable source classification, and stellar flare identification demonstrate that leveraging learned representations from FALCO achieves competitive or superior performance with reduced training samples compared to task-specific baselines. Future developments will extend the model to more complex scenarios, including multi-survey integration and irregular temporal sampling patterns.