Human Oversight-by-Design for Accessible Generative IUIs
Preprint
Abstract
LLM-generated interfaces are increasingly used in high-consequence workflows (e.g., healthcare communication), where how information is presented can impact downstream actions. These interfaces and their content support human interaction with AI-assisted decision-making and communication processes and should remain accessible and usable for people with disabilities. Accessible plain-language interfaces serve as an enabling infrastructure for meaningful human oversight. In these contexts, ethical and trustworthiness risks, including hallucinations, semantic distortion, bias, and accessibility barriers, can undermine reliability and limit users' ability to understand, monitor, and intervene in AI-supported processes. Yet, in practice, oversight is often treated as a downstream check, without clear rules for when human intervention is required or who is accountable. We propose oversight-by-design: embedding human judgment across the pipeline as an architectural commitment, implemented via escalation policies and explicit UI controls for risk signalling and intervention. Automated checks flag risk in generated UI communication that supports high-stakes workflows (e.g., readability, semantic fidelity, factual consistency, and standards-based accessibility constraints) and escalate to mandatory Human-in-the-Loop (HITL) review before release when thresholds are violated, or uncertainty is high. Human-on-the-Loop (HOTL) supervision monitors system-level signals over time (alerts, escalation rates, and compliance evidence) to tune policies and detect drift. Structured review feedback is translated into governance actions (rule and prompt updates, threshold calibration, and traceable audit logs), enabling scalable intervention and verifiable oversight for generative UI systems that support high-stakes workflows.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- ‘Human oversight’ in the EU artificial intelligence act: what, when and by whom?Law, Innovation and Technology, 2023
- Designing user interfaces for content simplification aimed at people with cognitive impairmentsUniversal Access in the Information Society, 2023
- EASIER System. Evaluating a Spanish Lexical Simplification Proposal with People with Cognitive ImpairmentsInternational Journal of Human–Computer Interaction, 2022
- The flaws of policies requiring human oversight of government algorithmsComputer Law & Security Review, 2022
- Human-Centered Artificial Intelligence: Reliable, Safe & TrustworthyInternational Journal of Human–Computer Interaction, 2020
- Closing the AI accountability gap2020
- Guidelines for Human-AI Interaction2019
- Man versus Machine or Man + Machine?IEEE Intelligent Systems, 2014
- A model for types and levels of human interaction with automationIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2000
- Does automation bias decision-making?International Journal of Human-Computer Studies, 1999