Educational Question Mining At Scale: Prediction, Analysis and Personalization
Preprint
Abstract
Online education platforms enable teachers to share a large number of educational resources such as questions to form exercises and quizzes for students. With large volumes of available questions, it is important to have an automated way to quantify their properties and intelligently select them for students, enabling effective and personalized learning experiences. In this work, we propose a framework for mining insights from educational questions at scale. We utilize the state-of-the-art Bayesian deep learning method, in particular partial variational auto-encoders (p-VAE), to analyze real students' answers to a large collection of questions. Based on p-VAE, we propose two novel metrics that quantify question quality and difficulty, respectively, and a personalized strategy to adaptively select questions for students. We apply our proposed framework to a real-world dataset with tens of thousands of questions and tens of millions of answers from an online education platform. Our framework not only demonstrates promising results in terms of statistical metrics but also obtains highly consistent results with domain experts' evaluation.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Handling incomplete heterogeneous data using VAEsPattern Recognition, 2020
- Twelve tips for rapidly migrating to online learning during the COVID-19 pandemicMedEdPublish, 2020
- COVID ‐19 and online teaching in higher education: A case study of Peking UniversityHuman Behavior and Emerging Technologies, 2020
- Catching Cheating StudentsEconomica, 2019
- Variational Autoencoders for Collaborative Filtering2018
- The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and TeachingInternational Journal of Artificial Intelligence in Education, 2014
- An Efficient Non-Negative Matrix-Factorization-Based Approach to Collaborative Filtering for Recommender SystemsIEEE Transactions on Industrial Informatics, 2014
- Student modeling approaches: A literature review for the last decadeExpert Systems with Applications, 2013
- Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive testsThe Annals of Statistics, 2009
- Assessing and Promoting Student Learning: Blurring the Line between Teaching and TestingTeaching of Psychology, 2000