Policy-Governed RAG - Research Design Study
Preprint
Abstract
A policy-governed RAG architecture is specified for audit-ready generation in regulated workflows, organized as a triptych: (I) Contracts/Control (SHRDLU-like), which governs output adherence to legal and internal policies; (II) Manifests/Trails (Memex-like), which cryptographically anchors all cited source evidence to ensure verifiable provenance; and (III) Receipts/Verification (Xanadu-like), which provides the final, portable proof of compliance for auditors (portable COSE/JOSE) (see Section 4 and Appendix A). Rather than explaining model internals, outputs are gated ex-ante and bound to cryptographically verifiable evidence for each material answer. Unvalidated targets are stated (>=20% relative reduction in confident errors; p95 latency <= 900 ms; <= 2.2x serve cost) together with a pre-registered (optional) pilot using NO-GO gates. The design complements existing RAG/guardrails by making policy checks auditable, replayable, and receipt-backed. Target domains include back-office compliance in pharma, medical devices, finance, legal, and the public sector where error costs may exceed thousands of euros and audit trails are mandatory under regulations such as the EU AI Act. Future evaluations may pre-commit to publishing negative results when any example NO-GO gate is not met.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Poisoning Web-Scale Training Datasets is Practical2024
- Certificate Transparency2013
- SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical TrialsAnnals of Internal Medicine, 2013
- CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trialsJournal of Clinical Epidemiology, 2010
- G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciencesBehavior Research Methods, 2007
- A Direct Approach to False Discovery RatesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- An Introduction to CopulasTechnometrics, 2000
- A Multiple Testing Procedure for Clinical TrialsBiometrics, 1979