Facilitating Proactive and Reactive Guidance for Decision Making on the Web: A Design Probe with WebSeek
Authors:
- Yanwei HuangYHYanwei Huang
- Arpit NarechaniaANArpit Narechania
Preprint
Abstract
Web AI agents such as ChatGPT Agent and GenSpark are increasingly used for routine web-based tasks, yet they still rely on text-based input prompts, lack proactive detection of user intent, and offer no support for interactive data analysis and decision making. We present WebSeek, a mixed-initiative browser extension that enables users to discover and extract information from webpages to then flexibly build, transform, and refine tangible data artifacts-such as tables, lists, and visualizations-all within an interactive canvas. Within this environment, users can perform analysis-including data transformations such as joining tables or creating visualizations-while an in-built AI both proactively offers context-aware guidance and automation, and reactively responds to explicit user requests. An exploratory user study (N=15) with WebSeek as a probe reveals participants' diverse analysis strategies, underscoring their desire for transparency and control during human-AI collaboration.Keywords
All Related Versions
This publication has 53 references indexed in Scilit:
- Understanding Generative AI Business Applications2024
- How May I Interrupt? Linguistic-Driven Design Guidelines for Proactive in-Car Voice AssistantsInternational Journal of Human–Computer Interaction, 2023
- Lyra 2: Designing Interactive Visualizations by DemonstrationIEEE Transactions on Visualization and Computer Graphics, 2020
- Agency plus automation: Designing artificial intelligence into interactive systemsProceedings of the National Academy of Sciences, 2019
- Futzing and Moseying: Interviews with Professional Data Analysts on Exploration PracticesIEEE Transactions on Visualization and Computer Graphics, 2018
- Vega-Lite: A Grammar of Interactive GraphicsIEEE Transactions on Visualization and Computer Graphics, 2016
- Visualization by Demonstration: An Interaction Paradigm for Visual Data ExplorationIEEE Transactions on Visualization and Computer Graphics, 2016
- Voyager: Exploratory Analysis via Faceted Browsing of Visualization RecommendationsIEEE Transactions on Visualization and Computer Graphics, 2015
- Enterprise Data Analysis and Visualization: An Interview StudyIEEE Transactions on Visualization and Computer Graphics, 2012
- Rigel: Transforming Tabular Data by Declarative MappingIEEE Transactions on Visualization and Computer Graphics, 1912