Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work
Top Cited Papers
Open Access
- 26 August 2022
- journal article
- review article
- Published by Springer Nature in Behavior Research Methods
- Vol. 55 (6) , 3026-3054
Abstract
Using traces of behaviors to predict outcomes is useful in varied contexts ranging from buyer behaviors to behaviors collected from smart-home devices. Increasingly, higher education systems have been using Learning Management System (LMS) digital data to capture and understand students’ learning and well-being. Researchers in the social sciences are increasingly interested in the potential of using digital log data to predict outcomes and design interventions. Using LMS data for predicting the likelihood of students’ success in for-credit college courses provides a useful example of how social scientists can use these techniques on a variety of data types. Here, we provide a primer on how LMS data can be feature-mapped and analyzed to accomplish these goals. We begin with a literature review summarizing current approaches to analyzing LMS data, then discuss ethical issues of privacy when using demographic data and equitable model building. In the second part of the paper, we provide an overview of popular machine learning algorithms and review analytic considerations such as feature generation, assessment of model performance, and sampling techniques. Finally, we conclude with an empirical example demonstrating the ability of LMS data to predict student success, summarizing important features and assessing model performance across different model specifications.Keywords
This publication has 73 references indexed in Scilit:
- Web usage mining for predicting final marks of students that use Moodle coursesComputer Applications in Engineering Education, 2013
- Evaluation of the lasso and the elastic net in genome-wide association studiesFrontiers in Genetics, 2013
- Predicting student failure at school using genetic programming and different data mining approaches with high dimensional and imbalanced dataApplied Intelligence, 2012
- Genomic selection using regularized linear regression models: ridge regression, lasso, elastic net and their extensionsBMC Proceedings, 2012
- Tracing information flow on a global scale using Internet chain-letter dataProceedings of the National Academy of Sciences, 2008
- Machine learning: a review of classification and combining techniquesArtificial Intelligence Review, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Dropout from Higher Education: A Theoretical Synthesis of Recent ResearchReview of Educational Research, 1975
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958