Abstract
The European Union published the Artificial Intelligence Act (AI Act) in a strategic effort to align the development and application of Artificial Intelligence (AI) in the common market. This act, one of the first laws of its kind, strengthened the development of trustworthy and human-centered AI through new regulations, prescribing requirements that providers of AI systems must conform to. The Act prescribes model-level technical requirements for high-risk AI systems, such as in terms of accuracy, robustness and fairness, which are to be addressed and reported in the form of conformity assessments. We identify, however, a significant gap between the high-level legal descriptions provided in the law and the low-level requirements needed for the implementation of automated assessment tools for algorithmic auditing. This gap is a major obstacle in the operationalization of AI Act compliance. The difficulties are aggravated due the lack of harmonized AI standards and the existing heterogeneity of AI models, datasets, and tasks. To address this gap, we present an open-source proof-of-concept assessment tool to operationalize the technical requirements of the AI Act according to the current regulatory landscape. With this tool, we demonstrate a bottom-up interpretation of the technical requirements of the AI Act for an automated evaluation of accuracy, robustness, and fairness. We apply our work to two neural network-based healthcare applications and discuss the requirements for further integration to initial conformity assessment and to extended application to post-market monitoring and other algorithmic auditing frameworks. With further work, the base structure presented here can be applied for integration beyond healthcare to other AI high-risk application domains.
Funding Information
  • Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut HHI

This publication has 48 references indexed in Scilit: