Demonstration Based Explainable AI for Learning From Demonstration Methods
- 9 May 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (7) , 6552-6559
Abstract
Learning from Demonstration (LfD) is a powerful type of machine learning that can allow novices to teach robots to complete various tasks. However, the learning process for these systems may still be difficult for novices to interpret and understand, making effective teaching challenging. Explainable artificial intelligence (XAI) aims to address this challenge by explaining a system to the user. In this work, we investigate XAI within LfD by implementing an adaptive explanatory feedback system on an inverse reinforcement learning (IRL) algorithm. The feedback is implemented by demonstrating selected learnt trajectories to users. The system adapts to user teaching by categorizing and then selectively sampling trajectories shown to a user, to show a representative sample of both successful and unsuccessful trajectories. The system was evaluated through a user study with 26 participants teaching a robot a multi-goal navigation task. The results of the user study demonstrated that the proposed explanatory feedback system can improve robot performance, teaching efficiency and the user's ability to predict the robot's goals and actions.Keywords
All Related Versions
Funding Information
- Australian Government Research Training Program
- ARC Future Fellowship (FT200100761)
This publication has 20 references indexed in Scilit:
- Explainable Artificial Intelligence: Evaluating the Objective and Subjective Impacts of xAI on Human-Agent InteractionInternational Journal of Human–Computer Interaction, 2022
- GraphLIME: Local Interpretable Model Explanations for Graph Neural NetworksIEEE Transactions on Knowledge and Data Engineering, 2022
- ARC-LfD: Using Augmented Reality for Interactive Long-Term Robot Skill Maintenance via Constrained Learning from Demonstration2021
- Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost DemonstrationsIEEE Robotics and Automation Letters, 2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- XAI—Explainable artificial intelligenceScience Robotics, 2019
- Robotics and Industry 4.02019
- Towards Ethical Guidelines of Using Telepresence Robots in Residential CareInternational Journal of Social Robotics, 2019
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018
- The impact of student feedback on teaching in higher educationAssessment & Evaluation in Higher Education, 2016