Open Access
- 7 March 2018
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 417-426
Abstract
In blended learning scenarios, evidence needs to be gathered from digital and physical spaces to obtain a more complete view of the teaching and learning processes. However, these scenarios are highly heterogeneous, and the varying data sources available in each particular context can condition the accuracy, relevance, interpretability and actionability of the Learning Analytics (LA) solutions, affecting also the user's sense of agency and trust in such solutions. To aid stakeholders in making use of learning analytics, we propose a process to involve teachers in customizing multimodal LA (MMLA) solutions, adapting them to their particular blended learning situation (e.g., identifying relevant data sources and metrics). Since measuring the added value of adopting an LA solution is not straightforward, we also propose a concrete method for doing so. The results obtained from two case studies in authentic, blended computer-supported collaborative learning settings show an improvement in the sensitivity and F1 scores of the customized MMLA solution. Aside from these quantitative improvements, participant teachers reported both an increment in the effort involved, but also increased relevance, understanding and actionability of the results.Keywords
Funding Information
- European Union (669074, 731685)
- Spanish Ministry of Economy and Competitiveness (TIN2014-53199-C3-2-R)
- Regional Government of Castilla y León (VA277U14, VA082U16)
This publication has 22 references indexed in Scilit:
- Learning Analytics in Small-scale Teacher-led Innovations: Ethical and Data Privacy IssuesJournal of Learning Analytics, 2016
- A rule-based indicator definition tool for personalized learning analytics2016
- Scripting and monitoring meet each other: Aligning learning analytics and learning design to support teachers in orchestrating CSCL situationsBritish Journal of Educational Technology, 2014
- Learning AnalyticsAmerican Behavioral Scientist, 2013
- The learning analytics cycle2012
- The pulse of learning analytics understandings and expectations from the stakeholders2012
- A reference model for learning analyticsInternational Journal of Technology Enhanced Learning, 2012
- Adaptive least squares support vector machines filter for hand tremor canceling in microsurgeryInternational Journal of Machine Learning and Cybernetics, 2011
- A framework for process–solution analysis in collaborative learning environmentsInternational Journal of Human-Computer Studies, 2008
- The Merits of Mixing Methods in EvaluationEvaluation, 2001