From law to practice: model-level operationalization of technical governance requirements for high-risk AI in healthcare
Authors:
Open Access
- 20 November 2026
- journal article
- Published by Springer Nature in AI and Ethics
- Vol. 6 (6)
Abstract
The European Union published the Artificial Intelligence Act (AI Act) in a strategic effort to align the development and application of Artificial Intelligence (AI) in the common market. This act, one of the first laws of its kind, strengthened the development of trustworthy and human-centered AI through new regulations, prescribing requirements that providers of AI systems must conform to. The Act prescribes model-level technical requirements for high-risk AI systems, such as in terms of accuracy, robustness and fairness, which are to be addressed and reported in the form of conformity assessments. We identify, however, a significant gap between the high-level legal descriptions provided in the law and the low-level requirements needed for the implementation of automated assessment tools for algorithmic auditing. This gap is a major obstacle in the operationalization of AI Act compliance. The difficulties are aggravated due the lack of harmonized AI standards and the existing heterogeneity of AI models, datasets, and tasks. To address this gap, we present an open-source proof-of-concept assessment tool to operationalize the technical requirements of the AI Act according to the current regulatory landscape. With this tool, we demonstrate a bottom-up interpretation of the technical requirements of the AI Act for an automated evaluation of accuracy, robustness, and fairness. We apply our work to two neural network-based healthcare applications and discuss the requirements for further integration to initial conformity assessment and to extended application to post-market monitoring and other algorithmic auditing frameworks. With further work, the base structure presented here can be applied for integration beyond healthcare to other AI high-risk application domains.Funding Information
- Fraunhofer-Institut für Nachrichtentechnik, Heinrich-Hertz-Institut HHI
This publication has 48 references indexed in Scilit:
- The Bidirectional Relationship Between XAI and Regulation: Operationalizing XAI for the AI Act2026
- AI Act high-risk AI compliance challenge and industry impact: A multiple case studyInformation and Software Technology, 2026
- Künstliche Intelligenz auf dem Prüfstand: Anforderungen, Qualitätskriterien und Prüfwerkzeuge für medizinische AnwendungenBundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 2025
- The EU Artificial Intelligence Act (2024): Implications for healthcareHealth Policy, 2024
- Making It Possible for the Auditing of AI: A Systematic Review of AI Audits and AI AuditabilityInformation Systems Frontiers, 2024
- Taking AI risks seriously: a new assessment model for the AI ActAI & SOCIETY, 2023
- Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI RegulationMinds and Machines, 2021
- The Relationship Between the Physician-Patient Relationship, Physician Empathy, and Patient TrustJournal of General Internal Medicine, 2021
- History of artificial intelligence in medicineGastrointestinal Endoscopy, 2020
- Artificial Intelligence and Patient-Centered Decision-MakingPhilosophy & Technology, 2020