ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database
Open Access
- 11 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
Scriptwriters usually rely on their mental visualization to create a vivid story by using their imagination to see, feel, and experience the scenes they are writing. Besides mental visualization, they often refer to existing images or scenes in movies and analyze the visual elements to create a certain mood or atmosphere. In this paper, we develop ScriptViz to provide external visualization based on a large movie database for the screenwriting process. It retrieves reference visuals on the fly based on scripts’ text and dialogue from a large movie database. The tool provides two types of control on visual elements that enable writers to 1) see exactly what they want with fixed visual elements and 2) see variances in uncertain elements. User evaluation among 15 scriptwriters shows that ScriptViz is able to present scriptwriters with consistent yet diverse visual possibilities, aligning closely with their scripts and helping their creation.Keywords
All Related Versions
Funding Information
- The Brown Institute for Media and Innovation (000000)
This publication has 23 references indexed in Scilit:
- Make-A-Story: Visual Memory Conditioned Consistent Story Generation2023
- InstructPix2Pix: Learning to Follow Image Editing Instructions2023
- StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation2022
- SemanticCollage2020
- A Graph-Based Framework to Bridge Movies and Synopses2019
- StoryGAN: A Sequential Conditional GAN for Story Visualization2019
- Creative Writing with a Machine in the Loop2018
- Computational video editing for dialogue-driven scenesACM Transactions on Graphics, 2017
- Characters in Search of an Author: AI-Based Virtual Storytelling2001
- Creating characters in a story-telling universePoetics, 1984