A Maturity Model for Trustworthy AI Software Development
Open Access
- 10 April 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (8) , 4771
Abstract
Recently, AI software has been rapidly growing and is widely used in various industrial domains, such as finance, medicine, robotics, and autonomous driving. Unlike traditional software, in which developers need to define and implement specific functions and rules according to requirements, AI software learns these requirements by collecting and training relevant data. For this reason, if unintended biases exist in the training data, AI software can create fairness and safety issues. To address this challenge, we propose a maturity model for ensuring trustworthy and reliable AI software, known as AI-MM, by considering common AI processes and fairness-specific processes within a traditional maturity model, SPICE (ISO/IEC 15504). To verify the effectiveness of AI-MM, we applied this model to 13 real-world AI projects and provide a statistical assessment on them. The results show that AI-MM not only effectively measures the maturity levels of AI projects but also provides practical guidelines for enhancing maturity levels.Keywords
Funding Information
- Institute for Information & communications Technology Planning & Evaluation (IITP) (2022-0-01045, 2022-0-00043, IITP-2020-0-01821)
- ICT Creative Consilience Program supervised by the IITP (2022-0-01045, 2022-0-00043, IITP-2020-0-01821)
This publication has 17 references indexed in Scilit:
- Characterizing Machine Learning Processes: A Maturity Framework2020
- Machine Learning Testing: Survey, Landscapes and HorizonsIEEE Transactions on Software Engineering, 2020
- Software Engineering for Machine Learning: A Case Study2019
- Model Cards for Model Reporting2019
- The ML test score: A rubric for ML production readiness and technical debt reduction2017
- CMMI / SPICE based process improvement2010
- Developing Maturity Models for IT ManagementBusiness & Information Systems Engineering, 2009
- Demonstrating the Impact and Benefits of CMMI (Trademark): An Update and Preliminary Results2003
- An empirical evaluation of the ISO/IEC 15504 assessment modelJournal of Systems and Software, 2001
- Fisher's Exact TestJournal of the Royal Statistical Society Series A: Statistics in Society, 1992