Am I Wrong, or Is the Autograder Wrong? Effects of AI Grading Mistakes on Learning
Open Access
- 7 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 159-176
Abstract
Errors in AI grading and feedback often have an intractable set of causes and are, by their nature, difficult to completely avoid. Since inaccurate feedback potentially harms learning, there is a need for designs and workflows that mitigate these harms. To better understand the mechanisms by which erroneous AI feedback impacts students’ learning, we conducted surveys and interviews that recorded students’ interactions with a short-answer AI autograder for “Explain in Plain English” code reading problems. Using causal modeling, we inferred the learning impacts of wrong answers marked as right (false positives, FPs) and right answers marked as wrong (false negatives, FNs). We further explored explanations for the learning impacts, including errors influencing participants’ engagement with feedback and assessments of their answers’ correctness, and participants’ prior performance in the class. FPs harmed learning in large part due to participants’ failures to detect the errors. This was due to participants not paying attention to the feedback after being marked as right, and an apparent bias against admitting one’s answer was wrong once marked right. On the other hand, FNs harmed learning only for survey participants, suggesting that interviewees’ greater behavioral and cognitive engagement protected them from learning harms. Based on these findings, we propose ways to help learners detect FPs and encourage deeper reflection on FNs to mitigate the learning harms of AI errors.Keywords
Funding Information
- University of Illinois at Urbana-Champaign (College of Engineering Strategic Research Initiatives Grant)
- Google (Ph.D. Fellowship)
- NSF (National Science Foundation) (DUE 21-21424, IIS-2016908)
This publication has 31 references indexed in Scilit:
- Exploring feedback and student characteristics relevant for personalizing feedback strategiesComputers & Education, 2014
- Enhancing learning through formative assessmentInnovations in Education and Teaching International, 2013
- The effect of positive feedback in a constraint-based intelligent tutoring systemComputers & Education, 2013
- Student engagement with assessment and feedback: Some lessons from short-answer free-text e-assessment questionsComputers & Education, 2012
- Beyond ‘doing time’: investigating the concept of student engagement with feedbackOxford Review of Education, 2011
- Are assessment environments gendered? An analysis of the learning responses of male and female students to different assessment environmentsAssessment & Evaluation in Higher Education, 2009
- Assessment of metacognitive skills by means of instruction to think aloud and reflect when prompted. Does the verbalisation method affect learning?Metacognition and Learning, 2007
- An Empirical Assessment of Comprehension Fostering Features in an Intelligent Tutoring System2002
- Control of Practice and Level of Feedback in Computer-Based InstructionContemporary Educational Psychology, 1995
- Adaptive Feedback in Computer-Based Instruction: Effects of Response Certitude on Performance, Feedback-Study Time, and EfficiencyJournal of Educational Computing Research, 1994