Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
Top Cited Papers
Open Access
- 19 April 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Abstract
We propose a conceptual perspective on prompts for Large Language Models (LLMs) that distinguishes between (1) diegetic prompts (part of the narrative, e.g. “Once upon a time, I saw a fox...”), and (2) non-diegetic prompts (external, e.g. “Write about the adventures of the fox.”). With this lens, we study how 129 crowd workers on Prolific write short texts with different user interfaces (1 vs 3 suggestions, with/out non-diegetic prompts; implemented with GPT-3): When the interface offered multiple suggestions and provided an option for non-diegetic prompting, participants preferred choosing from multiple suggestions over controlling them via non-diegetic prompts. When participants provided non-diegetic prompts it was to ask for inspiration, topics or facts. Single suggestions in particular were guided both with diegetic and non-diegetic information. This work informs human-AI interaction with generative models by revealing that (1) writing non-diegetic prompts requires effort, (2) people combine diegetic and non-diegetic prompting, and (3) they use their draft (i.e. diegetic information) and suggestion timing to strategically guide LLMs.Keywords
All Related Versions
Funding Information
- Bavarian State Ministry of Science and the Arts
This publication has 33 references indexed in Scilit:
- A Cost-Benefit Study of Text Entry Suggestion Interaction2016
- Effects of Language Modeling and its Personalization on Touchscreen Typing Performance2015
- Fitting Linear Mixed-Effects Models Usinglme42015
- RPackagemultgee: A Generalized Estimating Equations Solver for Multinomial ResponsesJournal of Statistical Software, 2015
- Complementing text entry evaluations with a composition taskACM Transactions on Computer-Human Interaction, 2014
- ContextType2013
- Modeling and Remodeling WritingWritten Communication, 2012
- WalkType2012
- Multidimensional pareto optimization of touchscreen keyboards for speed, familiarity and improved spell checking2012
- Enhancing the explanatory power of usability heuristics1994