Using Analytics on Student Created Data to Content Validate Pedagogical Tools
Preprint
Abstract
Conceptual and simulation models can function as useful pedagogical tools, however it is important to categorize different outcomes when evaluating them in order to more meaningfully interpret results. VERA is a ecology-based conceptual modeling software that enables users to simulate interactions between biotics and abiotics in an ecosystem, allowing users to form and then verify hypothesis through observing a time series of the species populations. In this paper, we classify this time series into common patterns found in the domain of ecological modeling through two methods, hierarchical clustering and curve fitting, illustrating a general methodology for showing content validity when combining different pedagogical tools. When applied to a diverse sample of 263 models containing 971 time series collected from three different VERA user categories: a Georgia Tech (GATECH), North Georgia Technical College (NGTC), and ``Self Directed Learners'', results showed agreement between both classification methods on 89.38\% of the sample curves in the test set. This serves as a good indication that our methodology for determining content validity was successful.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Item response analysis of computational thinking practices: Test characteristics and students’ learning abilities in visual programming contextsComputers in Human Behavior, 2021
- Hierarchical clustering of time series data with parametric derivative dynamic time warpingExpert Systems with Applications, 2016
- An improved logistic method for detecting spring vegetation phenology in grasslands from MODIS EVI time-series dataAgricultural and Forest Meteorology, 2015
- What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessmentAdvances in Health Sciences Education, 2013
- Algorithms for hierarchical clustering: an overviewWIREs Data Mining and Knowledge Discovery, 2011
- Structure, behavior, and function of complex systems: The structure, behavior, and function modeling languageArtificial Intelligence for Engineering Design, Analysis and Manufacturing, 2008
- Coupled Oscillations in Food Webs: Balancing Competition and Mutualism in Simple Ecological ModelsThe American Naturalist, 2004
- Seasonality extraction by function fitting to time-series of satellite sensor dataIEEE Transactions on Geoscience and Remote Sensing, 2002
- Growth models and their use in ecological modelling: an application to a fish populationEcological Modelling, 1998
- The Usefulness of Ecological Models: A Stock-TakingThe Quarterly Review of Biology, 1981