Open, Collaborative, and AI-Augmented Peer Assessment: Student Participation, Performance, and Perceptions
Open Access
- 9 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 496-500
Abstract
Research consistently shows that peer assessment affects student achievement and attitudes across various subjects and contexts. However, most studies have focused on anonymous peer assessments in small, one-time, and non-iterative settings. This large-scale longitudinal study explores the effects of open, collaborative, and AI-augmented peer assessment in a large online graduate course with 1,636 students across 12 semesters from 2018 to 2022. The research investigated how different groups of students participated in the peer assessment in an online graduate computer science class. We also explored how their participation influenced their learning performance and their perceptions. Key findings reveal that students' age and gender significantly affect engagement levels and the perception of peer assessment effectiveness. They also provide new insights into the positive relationship between providing feedback and enhanced learning performance. This paper presents the implementation of peer assessment and detailed findings of the study. The implications of the study for future research and practices are also discussed.Keywords
This publication has 25 references indexed in Scilit:
- Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature reviewComputers & Education, 2021
- An empirical review of anonymity effects in peer assessment, peer feedback, peer review, peer evaluation and peer gradingAssessment & Evaluation in Higher Education, 2019
- The impact of formative peer feedback on higher education students’ academic writing: a Meta-AnalysisAssessment & Evaluation in Higher Education, 2018
- Promoting learning by leveraging the collaborative nature of formative peer assessment with instructional scaffoldsEuropean Journal of Psychology of Education, 2017
- The role of anonymity in peer assessmentAssessment & Evaluation in Higher Education, 2016
- Peer-assessment in higher education – twenty-first century practices, challenges and the way forwardAssessment & Evaluation in Higher Education, 2015
- A factorization approach to evaluate open-response assignments in MOOCs using preference learning on peer assessmentsKnowledge-Based Systems, 2015
- Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratingsAssessment & Evaluation in Higher Education, 2015
- What if pupils can assess their peers anonymously? A quasi-experimental studyComputers & Education, 2015
- Effective peer assessment processes: Research findings and future directionsLearning and Instruction, 2010