Modeling Resilience of Collaborative AI Systems
Open Access
- 14 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 24-29
Abstract
A Collaborative Artificial Intelligence System (CAIS) performs actions in collaboration with the human to achieve a common goal. CAISs can use a trained AI model to control human-system interaction, or they can use human interaction to dynamically learn from humans in an online fashion. In online learning with human feedback, the AI model evolves by monitoring human interaction through the system sensors in the learning state, and actuates the autonomous components of the CAIS based on the learning in the operational state. Therefore, any disruptive event affecting these sensors may affect the AI model's ability to make accurate decisions and degrade the CAIS performance. Consequently, it is of paramount importance for CAIS managers to be able to automatically track the system performance to understand the resilience of the CAIS upon such disruptive events. In this paper, we provide a new framework to model CAIS performance when the system experiences a disruptive event. With our framework, we introduce a model of performance evolution of CAIS. The model is equipped with a set of measures that aim to support CAIS managers in the decision process to achieve the required resilience of the system. We tested our framework on a real-world case study of a robot collaborating online with the human, when the system is experiencing a disruptive event. The case study shows that our framework can be adopted in CAIS and integrated into the online execution of the CAIS activities.Keywords
All Related Versions
Funding Information
- Programma Operativo Nazionale Ricerca e Innovazione (PON) (CUP I51B21003890005, Codice DOT19L38RN-5)
This publication has 11 references indexed in Scilit:
- CAIS-DMA: A Decision-Making Assistant for Collaborative AI Systems2023
- GResilience: Trading Off Between the Greenness and the Resilience of Collaborative AI Systems2023
- Green Resilience of Cyber-Physical Systems2022
- Microservices integrated performance and reliability testing2022
- A Distributionally Robust Scheme for Critical Component Identification to Bolster Cyber-Physical Resilience of Power SystemsIEEE Transactions on Smart Grid, 2022
- Discussing resilience in the context of cyber physical systemsComputers & Industrial Engineering, 2021
- Detection and Identification of Cyber-Attacks in Cyber-Physical Systems Based on Machine Learning Methods2020
- A Distributed Multi-Agent Framework for Resilience Enhancement in Cyber-Physical SystemsIEEE Access, 2019
- Facilitating Human–Robot Collaborative Tasks by Teaching-Learning-Collaboration From Human DemonstrationsIEEE Transactions on Automation Science and Engineering, 2018
- Generic metrics and quantitative approaches for system resilience as a function of timeReliability Engineering & System Safety, 2012