An Exploratory Study on AI-driven Visualisation Techniques on Decision Making in Extended Reality
Preprint
Abstract
The integration of extended reality (XR) with artificial intelligence (AI) introduces a new paradigm for user interaction, enabling AI to perceive user intent, stimulate the senses, and influence decision-making. We explored the impact of four AI-driven visualisation techniques -- `Inform,' `Nudge,' `Recommend,' and `Instruct' -- on user decision-making in XR using the Meta Quest Pro. To test these techniques, we used a pre-recorded 360-degree video of a supermarket, overlaying each technique through a virtual interface. We aimed to investigate how these different visualisation techniques with different levels of user autonomy impact preferences and decision-making. An exploratory study with semi-structured interviews provided feedback and design recommendations. Our findings emphasise the importance of maintaining user autonomy, enhancing AI transparency to build trust, and considering context in visualisation design.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative studyJournal of the American Medical Informatics Association, 2023
- Not transparent and incomprehensible: A qualitative user study of an AI-empowered financial advisory systemData and Information Management, 2023
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial IntelligenceInformation Fusion, 2023
- User trust in artificial intelligence: A comprehensive conceptual frameworkElectronic Markets, 2022
- Elaborating Team Roles for Artificial Intelligence-based Teammates in Human-AI CollaborationGroup Decision and Negotiation, 2022
- Decision making under stress: the role of information overload, time pressure, complexity, and uncertaintyJournal of Decision Systems, 2020
- In AI we trust? Perceptions about automated decision-making by artificial intelligenceAI & SOCIETY, 2020
- A qualitative approach to HCI research2008
- Visual Analytics: Definition, Process, and Challenges2008
- Impact of color on marketingManagement Decision, 2006