Dynamic Abstractions: Building the Next Generation of Cognitive Tools and Interfaces | Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
Open Access
- 13 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Abstract
This workshop provides a forum to discuss, brainstorm, and prototype the next generation of interfaces that leverage the dynamic experiences enabled by recent advances in AI and the generative capabilities of foundation models. These models simplify complex tasks by generating outputs in various representations (e.g., text, images, videos) through diverse input modalities like natural language, voice, and sketch. They interpret user intent to generate and transform representations, potentially changing how we interact with information and express ideas. Inspired by this potential, technologists, theorists, and researchers are exploring new forms of interaction by building demos and communities dedicated to concretizing and advancing the vision of working with dynamic abstractions. This UIST workshop provides a timely space to discuss AI’s impact on how we might design and use cognitive tools (e.g., languages, notations, diagrams). We will explore the challenges, critiques, and opportunities of this space by thinking through and prototyping use cases across various domains.Keywords
This publication has 21 references indexed in Scilit:
- CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling2022
- Constructing Embodied Algebra by Sketching2021
- RealitySketch2020
- Interactive Body-Driven Graphics for Augmented Video Performance2019
- DreamSketch2017
- WritLarge2017
- Humane representation of thought2014
- Thinking with external representationsAI & SOCIETY, 2010
- External Representations Contribute to the Dynamic Construction of Ideas2002
- Reification, polymorphism and reuse2000