Designing and Evaluating an Educational Recommender System with Different Levels of User Control
Preprint
Abstract
Educational recommender systems (ERSs) play a crucial role in personalizing learning experiences and enhancing educational outcomes by providing recommendations of personalized resources and activities to learners, tailored to their individual learning needs. However, their effectiveness is often diminished by insufficient user control and limited transparency. To address these challenges, in this paper, we present the systematic design and evaluation of an interactive ERS, in which we introduce different levels of user control. Concretely, we introduce user control around the input (i.e., user profile), process (i.e., recommendation algorithm), and output (i.e., recommendations) of the ERS. To evaluate our system, we conducted an online user study (N=30) to explore the impact of user control on users' perceptions of the ERS in terms of several important user-centric aspects. Moreover, we investigated the effects of user control on multiple recommendation goals, namely transparency, trust, and satisfaction, as well as the interactions between these goals. Our results demonstrate the positive impact of user control on user perceived benefits of the ERS. Moreover, our study shows that user control strongly correlates with transparency and moderately correlates with trust and satisfaction. In terms of interaction between these goals, our results reveal that transparency moderately correlates and trust strongly correlates with satisfaction. Whereas, transparency and trust stand out as less correlated with each other.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Design of a conversational recommender system in educationUser Modeling and User-Adapted Interaction, 2024
- Interactive Explanation with Varying Level of Details in an Explainable Scientific Literature Recommender SystemInternational Journal of Human–Computer Interaction, 2023
- A systematic literature review on educational recommender systems for teaching and learning: research trends, limitations and opportunitiesEducation and Information Technologies, 2022
- The effects of controllability and explainability in a social recommender systemUser Modeling and User-Adapted Interaction, 2020
- A systematic review: machine learning based recommendation systems for e-learningEducation and Information Technologies, 2019
- Interactive recommender systems: A survey of the state of the art and future research challenges and opportunitiesExpert Systems with Applications, 2016
- Toward interactive context-aware affective educational recommendations in computer-assisted language learningNew Review of Hypermedia and Multimedia, 2015
- Evaluation and selection of group recommendation strategies for collaborative searching of learning objectsInternational Journal of Human-Computer Studies, 2015
- How should I explain? A comparison of different explanation types for recommender systemsInternational Journal of Human-Computer Studies, 2014
- Recommender Systems in Technology Enhanced Learning2010