Procedural Guide for System-Level Impact Evaluation of Industrial Artificial Intelligence-Driven Technologies: Application to Risk-Based Investment Analysis for Condition Monitoring Systems in Manufacturing
- 16 December 2021
- journal article
- research article
- Published by ASME International in Journal of Manufacturing Science and Engineering
- Vol. 144 (7) , 1-41
Abstract
Industrial artificial intelligence (IAI) and other analysis tools with obfuscated internal processes are growing in capability and ubiquity within industrial settings. Decision-makers share their concern regarding the objective evaluation of such tools and their impacts at the system level, facility level, and beyond. One application where this style of tool is making a significant impact is in Condition Monitoring Systems (CMSs). This paper addresses the need to evaluate CMSs, a collection of software and devices that alert users to changing conditions within assets or systems of a facility. The presented evaluation procedure uses CMSs as a case study for a broader philosophy evaluating the impacts of IAI tools. CMSs can provide value to a system by forewarning faults, defects, or other unwanted events. However, evaluating CMS value through scenarios that did not occur is rarely easy or intuitive. Further complicating this evaluation are the ongoing investment costs and risks posed by the CMS from imperfect monitoring. To overcome this, an industrial facility needs to regularly and objectively review CMS impacts to justify investments and maintain competitive advantage. This paper's procedure assesses the suitability of a CMS for a system in terms of risk and investment analysis. This risk-based approach uses the changes in the likelihood of good and bad events to quantify CMS value without making any one-time pointwise estimates. Fictional case studies presented in this paper illustrate the procedure and demonstrate its usefulness and validity.Keywords
This publication has 27 references indexed in Scilit:
- Quality and Inspection of Machining Operations: Tool Condition MonitoringJournal of Manufacturing Science and Engineering, 2010
- Hazard and operability (HAZOP) analysis. A literature reviewJournal of Hazardous Materials, 2010
- Reliability databases in perspectiveIEEE Transactions on Reliability, 2002
- Linking maintenance strategies to performanceInternational Journal of Production Economics, 2001
- Uncertainties in risk analysis: Six levels of treatmentReliability Engineering & System Safety, 1996
- Machine performance monitoring and proactive maintenance in computer-integrated manufacturing: review and perspectiveInternational Journal of Computer Integrated Manufacturing, 1995
- Implementing a Cost Effective Machinery Condition Monitoring Program1993
- Fault Trees vs. Event Trees in Reliability AnalysisRisk Analysis, 1984
- On The Quantitative Definition of RiskRisk Analysis, 1981
- Fuzzy setsInformation and Control, 1965