An Exploratory Evaluation of a Collaboration Feedback Report
Open Access
- 21 March 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 478-484
Abstract
Providing formative feedback to foster collaboration and improve students’ practice has been an emerging topic in CSCL and LA research communities. However, this pedagogical practice could be unrealistic in authentic classrooms, as observing and annotating improvements for every student and group exceeds the teacher’s capabilities. In the research area of group work and collaborative learning, current learning analytics solutions have reported accurate computational models to understand collaboration processes, yet evaluating formative collaboration feedback, where the final user is the student, is an under-explored research area. This paper reports an exploratory evaluation to understand the effects a collaboration feedback report through an authentic study conducted in regular classes. Fifty students from a Computer Science undergraduate program participated in the study. We followed an user-centered design approach to define six collaboration aspects that are relevant to students. These aspects were part of initial prototypes for the feedback report. From the exploratory intervention, we did not find effects between students who received the feedback (experimental condition) report and those who did not (control condition). Finally, this paper discusses design implications for further feedback report designs and interventions.Keywords
This publication has 14 references indexed in Scilit:
- Orchestration tools to support the teacher during student collaboration: a reviewUnterrichtswissenschaft, 2019
- Student perceptions of teamwork within assessment tasks in undergraduate science degreesAssessment & Evaluation in Higher Education, 2017
- Measuring University Students’ Group Work Contribution: Scale Development and ValidationSmall Group Research, 2017
- Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard ResearchIEEE Transactions on Learning Technologies, 2016
- Beyond DichotomiesZeitschrift für Psychologie, 2015
- Expertise estimation based on simple multimodal features2013
- A rating scheme for assessing the quality of computer-supported collaboration processesInternational Journal of Computer-Supported Collaborative Learning, 2007
- Deliberate Practice and the Acquisition and Maintenance of Expert Performance in Medicine and Related DomainsAcademic Medicine, 2004
- Research Methods in Education2002
- Deliberate practice at work: A study with insurance agentsJournal of Occupational and Organizational Psychology, 2000