Combining Clickstream Analyses and Graph-Modeled Data Clustering for Identifying Common Response Processes
Open Access
- 1 March 2021
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 86 (1) , 190-214
Abstract
Complex interactive test items are becoming more widely used in assessments. Being computer-administered, assessments using interactive items allow logging time-stamped action sequences. These sequences pose a rich source of information that may facilitate investigating how examinees approach an item and arrive at their given response. There is a rich body of research leveraging action sequence data for investigating examinees’ behavior. However, the associated timing data have been considered mainly on the item-level, if at all. Considering timing data on the action-level in addition to action sequences, however, has vast potential to support a more fine-grained assessment of examinees’ behavior. We provide an approach that jointly considers action sequences and action-level times for identifying common response processes. In doing so, we integrate tools from clickstream analyses and graph-modeled data clustering with psychometrics. In our approach, we (a) provide similarity measures that are based on both actions and the associated action-level timing data and (b) subsequently employ cluster edge deletion for identifying homogeneous, interpretable, well-separated groups of action patterns, each describing a common response process. Guidelines on how to apply the approach are provided. The approach and its utility are illustrated on a complex problem-solving item from PIAAC 2012.Keywords
Funding Information
- National Science Foundation of Sri Lanka (IIS-1633353)
This publication has 54 references indexed in Scilit:
- Assessing Individual Differences in Basic Computer SkillsEuropean Journal of Psychological Assessment, 2013
- Cluster Editing2013
- Cluster editing with locally bounded modificationsDiscrete Applied Mathematics, 2012
- Age Differences in Strategic Planning as Indexed by the Tower of LondonChild Development, 2011
- A More Relaxed Model for Graph-Based Data Clustering: s-Plex Cluster EditingSIAM Journal on Discrete Mathematics, 2010
- Large scale clustering of protein sequences with FORCE -A layout based heuristic for weighted cluster editingBMC Bioinformatics, 2007
- Cluster graph modification problemsDiscrete Applied Mathematics, 2004
- Correlation ClusteringMachine Learning, 2004
- A cutting plane algorithm for a clustering problemMathematical Programming, 1989
- NP-hard problems in hierarchical-tree clusteringActa Informatica, 1986