Students' experimentation strategies in design: Is process data enough?
- 12 July 2018
- journal article
- research article
- Published by Wiley in Computer Applications in Engineering Education
- Vol. 26 (5) , 1903-1914
Abstract
Conducting experiments is an important practice for both engineering design and scientific inquiry. Engineers iteratively conduct experiments to evaluate ideas, make informed decisions, and optimize their designs. However, both engineering design and scientific experimentation are open‐ended tasks that are not easy to assess. Recent studies have demonstrated how technology‐based assessments can help to capture and characterize these open‐ended tasks using unobtrusive data logging. This study builds upon a model to characterize students' experimentation strategies in design (ESD). Ten undergraduate students worked on a design challenge using a computer‐aided design (CAD) tool that captured all their interactions with the software. This “process data” was compared to “think‐aloud data,” which included students' explanations of their rationale for the experiments. The results suggest that the process data and the think‐aloud data have both affordances and limitations toward the goal of assessing students' ESD. While the process data was an effective approach to identify relevant sequences of actions, this type of data failed to ensure that students carried them out with a specific purpose. On the other hand, the think‐aloud data captured students' rationale for conducting experiments, but it depended on students' ability to verbalize their actions. In addition, the implementation of think‐aloud procedures and their analysis are time consuming tasks, and can only be done individually.Keywords
Funding Information
- Division of Research on Learning in Formal and Informal Settings (1503436)
- National Science Foundation (1503436)
This publication has 28 references indexed in Scilit:
- Data‐enabled cognitive modeling: Validating student engineers’ fuzzy design‐based decision‐making in a virtual design problemComputer Applications in Engineering Education, 2017
- The MOOC and learning analytics innovation cycle (MOLAC): a reflective summary of ongoing research and its challengesJournal of Computer Assisted Learning, 2016
- Exploring students' learning attitude and achievement in flipped learning supported computer aided design curriculum: A study in high school engineering educationComputer Applications in Engineering Education, 2015
- Educational Data Mining and Learning Analytics: Applications to Constructionist ResearchTechnology, Knowledge and Learning, 2014
- 3D‐CAD effects on creative design performance of different spatial abilities studentsJournal of Computer Assisted Learning, 2014
- Advancing Children’s Engineering Through Desktop Manufacturing2013
- The Informed Design Teaching and Learning MatrixJournal of Engineering Education, 2012
- A Document Analysis Method for Characterizing Design Team PerformanceJournal of Mechanical Design, 2003
- Creativity in the design process: co-evolution of problem–solutionDesign Studies, 2001
- Interest and effort in education.1913