DiaryPlay: AI-Assisted Authoring of Interactive Vignettes for Everyday Storytelling
Authors:
- Jiangnan XuJXJiangnan Xu
- Haeseul ChaHCHaeseul Cha
- Gosu ChoiGCGosu Choi
- Gyu-Cheol LeeGLGyu-Cheol Lee
- Yeo-Jin YoonYYYeo-Jin Yoon
- Zucheul LeeZLZucheul Lee
- Konstantinos PapangelisKPKonstantinos Papangelis
- Dae Hyun KimDKDae Hyun Kim
- Juho KimJKJuho Kim
Preprint
Abstract
An interactive vignette is a popular and immersive visual storytelling approach that invites viewers to role-play a character and influences the narrative in an interactive environment. However, it has not been widely used by everyday storytellers yet due to authoring complexity, which conflicts with the immediacy of everyday storytelling. We introduce DiaryPlay, an AI-assisted authoring system for interactive vignette creation in everyday storytelling. It takes a natural language story as input and extracts the three core elements of an interactive vignette (environment, characters, and events), enabling authors to focus on refining these elements instead of constructing them from scratch. Then, it automatically transforms the single-branch story input into a branch-and-bottleneck structure using an LLM-powered narrative planner, which enables flexible viewer interactions while freeing the author from multi-branching. A technical evaluation (N=16) shows that DiaryPlay-generated character activities are on par with human-authored ones regarding believability. A user study (N=16) shows that DiaryPlay effectively supports authors in creating interactive vignette elements, maintains authorial intent while reacting to viewer interactions, and provides engaging viewing experiences.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- MoGraphGPT : Creating Interactive Scenes Using Modular LLM and Graphical ControlIEEE Transactions on Visualization and Computer Graphics, 2026
- Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future ProspectsIEEE Access, 2025
- WhatELSE: Shaping Narrative Spaces at Configurable Level of Abstraction for AI-bridged Interactive Storytelling2025
- NarrativePlay: An Automated System for Crafting Visual Worlds in Novels for Role-PlayingProceedings of the AAAI Conference on Artificial Intelligence, 2024
- Vagueness in Natural Language2021
- Ephemeral Storytelling With Social Media: Snapchat and Instagram Stories at the Brooklyn MuseumSocial Media + Society, 2020
- Social impact theory: An examination of how immediacy operates as an influence upon social media interaction in Facebook fan pagesThe Marketing Review, 2016
- What makes virtual agents believable?Connection Science, 2016
- Extracting references between text and charts via crowdsourcing2014
- Using thematic analysis in psychologyQualitative Research in Psychology, 2006