Data challenges of time domain astronomy
Authors:
- Matthew J. GrahamMGMatthew J. Graham
- S. G. DjorgovskiSDS. G. Djorgovski
- Ashish MahabalAMAshish Mahabal
- Ciro DonalekCDCiro Donalek
- Andrew DrakeADAndrew Drake
- Giuseppe LongoGLGiuseppe Longo
Preprint
Abstract
Astronomy has been at the forefront of the development of the techniques and methodologies of data intensive science for over a decade with large sky surveys and distributed efforts such as the Virtual Observatory. However, it faces a new data deluge with the next generation of synoptic sky surveys which are opening up the time domain for discovery and exploration. This brings both new scientific opportunities and fresh challenges, in terms of data rates from robotic telescopes and exponential complexity in linked data, but also for data mining algorithms used in classification and decision making. In this paper, we describe how an informatics-based approach-part of the so-called "fourth paradigm" of scientific discovery-is emerging to deal with these. We review our experiences with the Palomar-Quest and Catalina Real-Time Transient Sky Surveys; in particular, addressing the issue of the heterogeneity of data associated with transient astronomical events (and other sensor networks) and how to manage and analyze it.Keywords
All Related Versions
- Version 1, 2012-08-13, ArXiv
- Published version: Distributed and Parallel Databases, 30 (5-6), 371.
This publication has 9 references indexed in Scilit:
- PROBABILISTIC CROSS-IDENTIFICATION OF COSMIC EVENTSThe Astrophysical Journal, 2011
- ON MACHINE-LEARNED CLASSIFICATION OF VARIABLE STARS WITH SPARSE AND NOISY TIME-SERIES DATAThe Astrophysical Journal, 2011
- FIRST RESULTS FROM THE CATALINA REAL-TIME TRANSIENT SURVEYThe Astrophysical Journal, 2009
- Distilling Free-Form Natural Laws from Experimental DataScience, 2009
- The Palomar‐Quest digital synoptic sky surveyAstronomische Nachrichten, 2008
- HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the SphereThe Astrophysical Journal, 2005
- An algorithm for optimal partitioning of data on an intervalIEEE Signal Processing Letters, 2005
- The discrete correlation function - A new method for analyzing unevenly sampled variability dataThe Astrophysical Journal, 1988
- Flicker of extragalactic radio sources at two frequenciesThe Astrophysical Journal, 1985