Explaining Recommendations in E-Learning: Effects on Adolescents' Trust
Authors:
Open Access
- 22 March 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 93-105
Abstract
In the scope of explainable artificial intelligence, explanation techniques are heavily studied to increase trust in recommender systems. However, studies on explaining recommendations typically target adults in e-commerce or media contexts; e-learning has received less research attention. To address these limits, we investigated how explanations affect adolescents’ initial trust in an e-learning platform that recommends mathematics exercises with collaborative filtering. In a randomized controlled experiment with 37 adolescents, we compared real explanations with placebo and no explanations. Our results show that real explanations significantly increased initial trust when trust was measured as a multidimensional construct of competence, benevolence, integrity, intention to return, and perceived transparency. Yet, this result did not hold when trust was measured one-dimensionally. Furthermore, not all adolescents attached equal importance to explanations and trust scores were high overall. These findings underline the need to tailor explanations and suggest that dynamically learned factors may be more important than explanations for building initial trust. To conclude, we thus reflect upon the need for explanations and recommendations in e-learning in low-stakes and high-stakes situations.Keywords
Funding Information
- Agentschap Innoveren en Ondernemen (HB.2020.2373)
- Fonds Wetenschappelijk Onderzoek (G0A3319N)
This publication has 49 references indexed in Scilit:
- Item difficulty estimation: An auspicious collaboration between data and judgmentComputers & Education, 2012
- Evaluating the effectiveness of explanations for recommender systemsUser Modeling and User-Adapted Interaction, 2012
- Computer adaptive practice of Maths ability using a new item response model for on the fly ability and difficulty estimationComputers & Education, 2011
- The effects of transparency on trust in and acceptance of a content-based art recommenderUser Modeling and User-Adapted Interaction, 2008
- Trust-inspiring explanation interfaces for recommender systemsKnowledge-Based Systems, 2007
- Evaluating implicit measures to improve web searchACM Transactions on Information Systems, 2005
- Trust in Automation: Designing for Appropriate RelianceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004
- Developing and Validating Trust Measures for e-Commerce: An Integrative TypologyInformation Systems Research, 2002
- Trust between humans and machines, and the design of decision aidsInternational Journal of Man-Machine Studies, 1987
- The mindlessness of ostensibly thoughtful action: The role of "placebic" information in interpersonal interaction.Journal of Personality and Social Psychology, 1978