Autonomously Generating Hints by Inferring Problem Solving Policies
Authors:
Open Access
- 14 March 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 195-204
Abstract
Exploring the whole sequence of steps a student takes to produce work, and the patterns that emerge from thousands of such sequences is fertile ground for a richer understanding of learning. In this paper we autonomously generate hints for the Code.org `Hour of Code,' (which is to the best of our knowledge the largest online course to date) using historical student data. We first develop a family of algorithms that can predict the way an expert teacher would encourage a student to make forward progress. Such predictions can form the basis for effective hint generation systems. The algorithms are more accurate than current state-of-the-art methods at recreating expert suggestions, are easy to implement and scale well. We then show that the same framework which motivated the hint generating algorithms suggests a sequence-based statistic that can be measured for each learner. We discover that this statistic is highly predictive of a student's future success.Keywords
Funding Information
- NSF (DGE-114747)
This publication has 17 references indexed in Scilit:
- Peer and self assessment in massive online classesACM Transactions on Computer-Human Interaction, 2013
- A Canonicalizing Model for Building Programming Tutors2012
- BlueFix: Using Crowd-Sourced Feedback to Support Programming Students in Error Diagnosis and Repair2012
- Debugging: finding, fixing and flailing, a multi-institutional study of novice debuggersComputer Science Education, 2008
- Toward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data2008
- An analysis of patterns of debugging among novice computer science studentsACM SIGCSE Bulletin, 2005
- On automated grading of programming assignments in an academic institutionComputers & Education, 2003
- An effective metacognitive strategy: learning by doing and explaining with a computer‐based Cognitive TutorCognitive Science, 2002
- Robust algorithm for real-time route planningIEEE Transactions on Aerospace and Electronic Systems, 2000
- Stochastic GamesProceedings of the National Academy of Sciences, 1953