Using Networks to Visualize and Analyze Process Data for Educational Assessment
Authors:
- 1 May 2016
- journal article
- Published by Wiley in Journal of Educational Measurement
- Vol. 53 (2) , 190-211
Abstract
New technology enables interactive and adaptive scenario‐based tasks (SBTs) to be adopted in educational measurement. At the same time, it is a challenging problem to build appropriate psychometric models to analyze data collected from these tasks, due to the complexity of the data. This study focuses on process data collected from SBTs. We explore the potential of using concepts and methods from social network analysis to represent and analyze process data. Empirical data were collected from the assessment of Technology and Engineering Literacy, conducted as part of the National Assessment of Educational Progress. For the activity sequences in the process data, we created a transition network using weighted directed networks, with nodes representing actions and directed links connecting two actions only if the first action is followed by the second action in the sequence. This study shows how visualization of the transition networks represents process data and provides insights for item design. This study also explores how network measures are related to existing scoring rubrics and how detailed network measures can be used to make intergroup comparisons.Keywords
This publication has 18 references indexed in Scilit:
- Statistical Models for Social NetworksAnnual Review of Sociology, 2011
- Epistemic Network Analysis: A Prototype for 21st-Century Assessment of LearningInternational Journal of Learning and Media, 2009
- An exploration of the use of eye‐gaze tracking to study problem‐solving on standardized science assessmentsInternational Journal of Research & Method in Education, 2006
- Analysis of weighted networksPhysical Review E, 2004
- The Structure and Function of Complex NetworksSIAM Review, 2003
- A p* primer: logit models for social networksSocial Networks, 1999
- Graph drawing by force‐directed placementSoftware: Practice and Experience, 1991
- Pseudolikelihood Estimation for Social NetworksJournal of the American Statistical Association, 1990
- An Exponential Family of Probability Distributions for Directed GraphsJournal of the American Statistical Association, 1981
- Centrality in social networks conceptual clarificationSocial Networks, 1978