Using machine learning for discovery in synoptic survey imaging data
Open Access
- 29 August 2013
- journal article
- research article
- Published by Oxford University Press (OUP) in Monthly Notices of the Royal Astronomical Society
- Vol. 435 (2) , 1047-1060
Abstract
Modern time-domain surveys continuously monitor large swaths of the sky to look for astronomical variability. Astrophysical discovery in such data sets is complicated by the fact that detections of real transient and variable sources are highly outnumbered by ‘bogus’ detections caused by imperfect subtractions, atmospheric effects and detector artefacts. In this work, we present a machine-learning (ML) framework for discovery of variability in time-domain imaging surveys. Our ML methods provide probabilistic statements, in near real time, about the degree to which each newly observed source is an astrophysically relevant source of variable brightness. We provide details about each of the analysis steps involved, including compilation of the training and testing sets, construction of descriptive image-based and contextual features, and optimization of the feature subset and model tuning parameters. Using a validation set of nearly 30 000 objects from the Palomar Transient Factory, we demonstrate a missed detection rate of at most 7.7 per cent at our chosen false-positive rate of 1 per cent for an optimized ML classifier of 23 features, selected to avoid feature correlation and overfitting from an initial library of 42 attributes. Importantly, we show that our classification methodology is insensitive to mislabelled training data up to a contamination of nearly 10 per cent, making it easier to compile sufficient training sets for accurate performance in future surveys. This ML framework, if so adopted, should enable the maximization of scientific gain from future synoptic survey and enable fast follow-up decisions on the vast amounts of streaming data produced by such experiments.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- ACTIVE LEARNING TO OVERCOME SAMPLE SELECTION BIAS: APPLICATION TO PHOTOMETRIC VARIABLE STAR CLASSIFICATIONThe Astrophysical Journal, 2011
- QUASI-STELLAR OBJECT SELECTION ALGORITHM USING TIME VARIABILITY AND MACHINE LEARNING: SELECTION OF 1620 QUASI-STELLAR OBJECT CANDIDATES FROM MACHO LARGE MAGELLANIC CLOUD DATABASEThe Astrophysical Journal, 2011
- ON MACHINE-LEARNED CLASSIFICATION OF VARIABLE STARS WITH SPARSE AND NOISY TIME-SERIES DATAThe Astrophysical Journal, 2011
- RANDOM FORESTS FOR PHOTOMETRIC REDSHIFTSThe Astrophysical Journal, 2010
- The Palomar Transient Factory: System Overview, Performance, and First ResultsPublications of the Astronomical Society of the Pacific, 2009
- Exploring the Optical Transient Sky with the Palomar Transient FactoryPublications of the Astronomical Society of the Pacific, 2009
- Conditional variable importance for random forestsBMC Bioinformatics, 2008
- How to Find More Supernovae with Less Work: Object Classification Techniques for Difference ImagingThe Astrophysical Journal, 2007
- The VizieR database of astronomical cataloguesAstronomy and Astrophysics Supplement Series, 2000
- SExtractor: Software for source extractionAstronomy and Astrophysics Supplement Series, 1996