POLARIS: A Framework to Guide the Development of Trustworthy AI Systems
Open Access
- 14 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 200-210
Abstract
In the ever-expanding landscape of Artificial Intelligence (AI), where innovation thrives and new products and services are continuously being delivered, ensuring that AI systems are designed and developed responsibly throughout their entire lifecycle is crucial. To this end, several AI ethics principles and guidelines have been issued to which AI systems should conform. Nevertheless, relying solely on high-level AI ethics principles is far from sufficient to ensure the responsible engineering of AI systems. In this field, AI professionals often navigate by sight. Indeed, while recommendations promoting Trustworthy AI (TAI) exist, they are often high-level statements difficult to translate into concrete implementation strategies. Currently, there is a significant gap between high-level AI ethics principles and low-level concrete practices for AI professionals. To address this challenge, our work presents an experience report where we develop a novel holistic framework for Trustworthy AI --- designed to bridge the gap between theory and practice --- and report insights from its application in an industrial case study. The framework builds up from the results of a systematic review of the state of the practice as well as a survey and think-aloud interviews with 34 AI practitioners. The framework, unlike most of the ones in literature, is designed to provide actionable guidelines and tools to support different types of stakeholders throughout the entire Software Development Life Cycle (SDLC). Our goal is to empower AI professionals to confidently navigate the ethical dimensions of TAI through practical insights, ensuring that the vast potential of AI is exploited responsibly for the benefit of society as a whole.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- The Social Impact of Generative AI: An Analysis on ChatGPT2023
- Improving the User Experience and the Trustworthiness of Financial Services2021
- From local explanations to global understanding with explainable AI for treesNature Machine Intelligence, 2020
- A Unified Framework of Five Principles for AI in SocietySSRN Electronic Journal, 2019
- The global landscape of AI ethics guidelinesNature Machine Intelligence, 2019
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Guidelines for conducting and reporting case study research in software engineeringEmpirical Software Engineering, 2008
- Alleviating the opacity of neural networks2002
- Computer Vision and Applications: A Guide for Students and PractitionersJournal of Electronic Imaging, 2002
- A Comparison of Concurrent and Retrospective Verbal Protocol AnalysisThe American Journal of Psychology, 2000