ShadAR: LLM-driven shader generation to transform visual perception in Augmented Reality
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Abstract
Augmented Reality (AR) can visually transform a user’s world by rendering virtual content on top of reality. However, developing such AR apps and visualizations remains a complex process that requires an understanding of computer vision and programming skills. We present ShadAR, an AR prototyping pipeline that enables real-time creation of small AR visualizations and applications using large language models (LLMs) and object detection. ShadAR allows users to express their visual intent (e.g., pixelate every person around me) via natural language, which is interpreted by an LLM to generate corresponding shader code. This shader is then compiled in real-time and applied to the passthrough video stream.Keywords
This publication has 9 references indexed in Scilit:
- ShadAR: LLM-driven shader generation to transform visual perception in Augmented Reality2025
- LLM Integration in Extended Reality: A Comprehensive Review of Current Trends, Challenges, and Future Perspectives2025
- YOLOv11: An Overview of the Key Architectural EnhancementsarXiv, 2024
- A Design Space for Vision Augmentations and Augmented Human Perception using Digital Eyewear2024
- LLMR: Real-time Prompting of Interactive Worlds using Large Language Models2024
- Seeing our Blind Spots: Smart Glasses-based Simulation to Increase Design Students’ Awareness of Visual Impairment2022
- CatARact: Simulating Cataracts in Augmented Reality2020
- Immersive Simulation of Visual Impairments Using a Wearable See-through Display2015
- Augmented Reality Art2014