Hidden Markov Models and Their Application for Predicting Failure Events
- 15 June 2020
- book chapter
- Published by Springer Nature
- Vol. 12139, 464-477
Abstract
We show how Markov mixed membership models (MMMM) can be used to predict the degradation of assets. We model the degradation path of individual assets, to predict overall failure rates. Instead of a separate distribution for each hidden state, we use hierarchical mixtures of distributions in the exponential family. In our approach the observation distribution of the states is a finite mixture distribution of a small set of (simpler) distributions shared across all states. Using tied-mixture observation distributions offers several advantages. The mixtures act as a regularization for typically very sparse problems, and they reduce the computational effort for the learning algorithm since there are fewer distributions to be found. Using shared mixtures enables sharing of statistical strength between the Markov states and thus transfer learning. We determine for individual assets the trade-off between the risk of failure and extended operating hours by combining a MMMM with a partially observable Markov decision process (POMDP) to dynamically optimize the policy for when and how to maintain the asset.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- A Unified Framework for Optimization Under Uncertainty2016
- How to interpret the results of medical time series data analysis: Classical statistical approaches versus dynamic Bayesian network modelingJournal of Pathology Informatics, 2016
- Tutorial on Stochastic Optimization in Energy—Part I: Modeling and PoliciesIEEE Transactions on Power Systems, 2015
- Bayesian Data Analysis2013
- A survey of point-based POMDP solversAutonomous Agents and Multi-Agent Systems, 2012
- Probabilistic topic modelsCommunications of the ACM, 2012
- AN INTRODUCTION TO HIDDEN MARKOV MODELS AND BAYESIAN NETWORKS2001
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- Inference Based on Imputed Failure Times for the Proportional Hazards Model with Interval-Censored DataJournal of the American Statistical Association, 1998
- The viterbi algorithmProceedings of the IEEE, 1973