An exploratory analysis of the latent structure of process data via action sequence autoencoders
Authors:
- 22 May 2020
- journal article
- research article
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 74 (1) , 1-33
Abstract
Computer simulations have become a popular tool for assessing complex skills such as problem‐solving. Log files of computer‐based items record the human–computer interactive processes for each respondent in full. The response processes are very diverse, noisy, and of non‐standard formats. Few generic methods have been developed to exploit the information contained in process data. In this paper we propose a method to extract latent variables from process data. The method utilizes a sequence‐to‐sequence autoencoder to compress response processes into standard numerical vectors. It does not require prior knowledge of the specific items and human–computer interaction patterns. The proposed method is applied to both simulated and real process data to demonstrate that the resulting latent variables extract useful information from the response processes.Keywords
All Related Versions
Funding Information
- National Science Foundation (SES‐1826540, IIS‐1633360)
This publication has 22 references indexed in Scilit:
- Understanding students' performance in a computer-based assessment of complex problem solving: An analysis of behavioral data from computer-generated log filesComputers in Human Behavior, 2016
- Analyzing Process Data from Problem-Solving Items with N-Grams2016
- A Hierarchical Neural Autoencoder for Paragraphs and Documents2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Early Stopping — But When?2012
- A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test TakersPsychometrika, 2009
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- 10.1162/153244303322533223Applied Physics Letters, 2000
- Long Short-Term MemoryNeural Computation, 1997
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951