Bayesian Online Learning of the Hazard Rate in Change-Point Problems
- 1 September 2010
- journal article
- Published by MIT Press in Neural Computation
- Vol. 22 (9) , 2452-2476
Abstract
Change-point models are generative models of time-varying data in which the underlying generative parameters undergo discontinuous changes at different points in time known as change points. Change-points often represent important events in the underlying processes, like a change in brain state reflected in EEG data or a change in the value of a company reflected in its stock price. However, change-points can be difficult to identify in noisy data streams. Previous attempts to identify change-points online using Bayesian inference relied on specifying in advance the rate at which they occur, called the hazard rate (h). This approach leads to predictions that can depend strongly on the choice of h and is unable to deal optimally with systems in which h is not constant in time. In this letter, we overcome these limitations by developing a hierarchical extension to earlier models. This approach allows h itself to be inferred from the data, which in turn helps to identify when change-points occur. We show that our approach can effectively identify change-points in both toy and real data sets with complex hazard rates and how it can be used as an ideal-observer model for human and animal behavior when faced with rapidly changing inputs.Keywords
This publication has 23 references indexed in Scilit:
- Detecting and predicting changesCognitive Psychology, 2009
- Learning the value of information in an uncertain worldNature Neuroscience, 2007
- Prefrontal Neural Correlates of Memory for SequencesJournal of Neuroscience, 2007
- Estimation and comparison of multiple change-point modelsJournal of Econometrics, 1998
- Testing and Locating Variance Changepoints with Application to Stock PricesJournal of the American Statistical Association, 1997
- A Bayesian Analysis for Change Point ProblemsJournal of the American Statistical Association, 1993
- Automatic adaptive segmentation of clinical EEGsElectroencephalography and Clinical Neurophysiology, 1981
- Feature extraction from the electroencephalogram by adaptive segmentationProceedings of the IEEE, 1977
- The Effectiveness of Quality Control ChartsJournal of the American Statistical Association, 1950
- A Simple Objective Technique for Measuring Flexibility in ThinkingThe Journal of General Psychology, 1948