A Dashboard to Provide Instructors with Automated Feedback on Students’ Peer Review Comments
Open Access
- 13 March 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 619-625
Abstract
Writing-to-Learn (WTL) is an evidence-based instructional practice which can help students construct knowledge across many disciplines. Though it is known to be an effective practice, many instructors do not implement WTL in their courses due to time constraints and inability to provide students with personalized feedback. One way to address this is to include peer review, which allows students to receive feedback on their writing and benefits them as they act as reviewers. To further ease the implementation of peer review and provide instructors with feedback on their students’ work, we labeled students’ peer review comments across courses for type of feedback provided and trained a machine learning model to automatically classify those comments, improving upon models reported in prior work. We then created a dashboard which takes students’ comments, labels the comments using the model, and allows instructors to filter through their students’ comments based on how the model labels the comments. This dashboard can be used by instructors to monitor the peer review collaborations occurring in their courses. The dashboard will allow them to efficiently use information provided by peers to identify common issues in their students’ writing and better evaluate the quality of their students’ peer review.Keywords
This publication has 29 references indexed in Scilit:
- Optimal classifier for imbalanced data using Matthews Correlation Coefficient metricPLOS ONE, 2017
- The nature of feedback: How peer feedback features affect students’ implementation rate and quality of revisions.Journal of Educational Psychology, 2016
- Peer review: Is Giving Corrective Feedback Better than Receiving it in L2 Writing?Procedia - Social and Behavioral Sciences, 2013
- A Framework for Evaluation and Use of Automated ScoringEducational Measurement: Issues and Practice, 2012
- Harnessing Technology to Improve Formative Assessment of Student Conceptions in STEM: Forging a National NetworkCBE—Life Sciences Education, 2011
- To give is better than to receive: The benefits of peer review to the reviewer's own writingJournal of Second Language Writing, 2009
- Writing for Learning in Science: A Secondary Analysis of Six StudiesInternational Journal of Science and Mathematics Education, 2007
- The Effects of School-Based Writing-to-Learn Interventions on Academic Achievement: A Meta-AnalysisReview of Educational Research, 2004
- PROBLEM-BASED WRITING WITH PEER REVIEW IMPROVES ACADEMIC PERFORMANCE IN PHYSIOLOGYAdvances in Physiology Education, 2002
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960