A conversational agent for creating automations exploiting large language models
Open Access
- 4 July 2024
- journal article
- research article
- Published by Springer Nature in Personal and Ubiquitous Computing
- Vol. 28 (6) , 931-946
Abstract
The proliferation of sensors and smart Internet of Things (IoT) devices in our everyday environments is reshaping our interactions with everyday objects. This change underlines the need to empower non-expert users to easily configure the behaviour of these devices to align with their preferences and habits. At the same time, recent advances in generative transformers, such as ChatGPT, have opened up new possibilities in a variety of natural language processing tasks, enhancing reasoning capabilities and conversational interactions. This paper presents RuleBot + + , a conversational agent that exploits GPT-4 to assist the user in the creation and modification of trigger-action automations through natural language. After an introduction to motivations and related work, we present the design and implementation of RuleBot + + and report the results of the user test in which users interacted with our solution and Home Assistant, one of the most used open-source tools for managing smart environments.Keywords
Funding Information
- ISTI - PISA
This publication has 18 references indexed in Scilit:
- Language and Temporal Aspects: A Qualitative Study on Trigger Interpretation in Trigger-Action Rules2023
- Defining Trigger-Action Rules via Voice: A Novel Approach for End-User Development in the IoT2023
- A Conversational Agent for Creating Flexible Daily Automation2022
- Managing non-trivial internet-of-things systems with conversational assistants: A prototype and a feasibility experimentJournal of Computational Science, 2021
- How Users Interpret Bugs in Trigger-Action Programming2019
- When Smart Devices Are Stupid: Negative Experiences Using Home Smart Devices2019
- Supporting mental model accuracy in trigger-action programming2015
- Learning from a learning thermostat2013
- Home automation in the wild2011
- Enhancing the explanatory power of usability heuristics1994