Application of Markov renewal theory and semi‐Markov decision processes in maintenance modeling and optimization of multi‐unit systems
Authors:
- 3 August 2020
- journal article
- research article
- Published by Wiley in Naval Research Logistics (NRL)
- Vol. 67 (7) , 548-558
Abstract
In this paper, a condition‐based maintenance model for a multi‐unit production system is proposed and analyzed using Markov renewal theory. The units of the system are subject to gradual deterioration, and the gradual deterioration process of each unit is described by a three‐state continuous time homogeneous Markov chain with two working states and a failure state. The production rate of the system is influenced by the deterioration process and the demand is constant. The states of the units are observable through regular inspections and the decision to perform maintenance depends on the number of units in each state. The objective is to obtain the steady‐state characteristics and the formula for the long‐run average cost for the controlled system. The optimal policy is obtained using a dynamic programming algorithm. The result is validated using a semi‐Markov decision process formulation and the policy iteration algorithm. Moreover, an analytical expression is obtained for the calculation of the mean time to initiate maintenance using the first passage time theory.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada (RGPIN‐2018‐0)
This publication has 29 references indexed in Scilit:
- Optimizing usage and maintenance decisions for k‐out‐of‐n systems of moving assetsNaval Research Logistics (NRL), 2017
- Selective maintenance planning of a steel truss bridge based on the Markovian approachEngineering Structures, 2016
- Season-Dependent Condition-Based Maintenance for a Wind Turbine Using a Partially Observed Markov Decision ProcessIEEE Transactions on Power Systems, 2010
- A review on machinery diagnostics and prognostics implementing condition-based maintenanceMechanical Systems and Signal Processing, 2006
- A sequential condition‐based repair/replacement policy with non‐periodic inspections for a system subject to continuous wearApplied Stochastic Models in Business and Industry, 2003
- Markov regenerative stochastic Petri netsPerformance Evaluation, 1994
- Monotone optimal preventive maintenance policies for stochastically failing equipmentNaval Research Logistics Quarterly, 1981
- Markov renewal theoryAdvances in Applied Probability, 1969
- A Dynamic Programming Algorithm for Embedded Markov Chains when the Planning Horizon is at InfinityManagement Science, 1964
- Markov-Renewal Programming. II: Infinite Return Models, ExampleOperations Research, 1963