Adoption of Watermarking for Generative AI Systems in Practice and Implications under the new EU AI Act
Authors:
Preprint
Abstract
AI-generated images have become so good in recent years that individuals cannot distinguish them any more from "real" images. This development creates a series of societal risks, and challenges our perception of what is true and what is not, particularly with the emergence of "deep fakes" that impersonate real individuals. Watermarking, a technique that involves embedding identifying information within images to indicate their AI-generated nature, has emerged as a primary mechanism to address the risks posed by AI-generated images. The implementation of watermarking techniques is now becoming a legal requirement in many jurisdictions, including under the new 2024 EU AI Act. Despite the widespread use of AI image generation systems, the current status of watermarking implementation remains largely unexamined. Moreover, the practical implications of the AI Act's watermarking requirements have not previously been studied. The present paper therefore both provides an empirical analysis of 50 of the most widely used AI systems for image generation, and embeds this empirical analysis into a legal analysis of the AI Act. We identify four categories of generative AI image systems relevant under the AI Act, outline the legal obligations for each category, and find that only a minority number of providers currently implement adequate watermarking practices.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- What constitutes a Deep Fake? The blurry line between legitimate processing and manipulation under the EU AI Act2025
- Better alone than in bad company: Addressing the risks of companion chatbots through data protection by designComputer Law & Security Review, 2024
- AI models collapse when trained on recursively generated dataNature, 2024
- Photorealistic Text-To-Image Diffusion Models with Deep Language Understanding2022
- Robust and blind image watermarking in DCT domain using inter-block coefficient correlationInformation Sciences, 2020