Christopher D. Wilson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Christopher D. Wilson has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Brian M. Donovan
BSCS Science Learning Colorado Springs Colorado USA
1 shared publication - Janet Carlson
Graduate School of Education, Stanford University, Stanford, USA
1 shared publication - Jonathan Osborne
Graduate School of Education Stanford University Stanford California USA
1 shared publication - Joseph A. Taylor
College of Education, University of Colorado Colorado Springs
1 shared publication - Kevin C. Haudek
Department of Biochemistry and Molecular Biology, Michigan State University, East Lansing, USA
1 shared publication Marisol M. Santiago
Michigan State University East Lansing Michigan USA
1 shared publication
Latest Publications
- 4 May 2023
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 61 (1) , 38-69
Using automated analysis to assess middle school students' competence with scientific argumentation
Argumentation is fundamental to science education, both as a prominent feature of scientific reasoning and as an effective mode of learning—a perspective reflected in contemporary frameworks and standards. The successful implementation of argumentation in school science, however, requires a paradigm shift in science assessment from the measurement of knowledge and understanding to the measurement of performance and knowledge in use. Performance tasks requiring argumentation must capture the many ways students can construct and evaluate arguments in science, yet such tasks are both expensive and resource‐intensive to score. In this study we explore how machine learning text classification techniques can be applied to develop efficient, valid, and accurate constructed‐response measures of students' competency with written scientific argumentation that are aligned with a validated argumentation learning progression. Data come from 933 middle school students in the San Francisco Bay Area and are based on three sets of argumentation items in three different science contexts. The findings demonstrate that we have been able to develop computer scoring models that can achieve substantial to almost perfect agreement between human‐assigned and computer‐predicted scores. Model performance was slightly weaker for harder items targeting higher levels of the learning progression, largely due to the linguistic complexity of these responses and the sparsity of higher‐level responses in the training data set. Comparing the efficacy of different scoring approaches revealed that breaking down students' arguments into multiple components (e.g., the presence of an accurate claim or providing sufficient evidence), developing computer models for each component, and combining scores from these analytic components into a holistic score produced better results than holistic scoring approaches. However, this analytical approach was found to be differentially biased when scoring responses from English learners (EL) students as compared to responses from non‐EL students on some items. Differences in the severity between human and computer scores for EL between these approaches are explored, and potential sources of bias in automated scoring are discussed.
- 4 May 2023
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 61 (1) , 38-69
Using automated analysis to assess middle school students' competence with scientific argumentation
Argumentation is fundamental to science education, both as a prominent feature of scientific reasoning and as an effective mode of learning—a perspective reflected in contemporary frameworks and standards. The successful implementation of argumentation in school science, however, requires a paradigm shift in science assessment from the measurement of knowledge and understanding to the measurement of performance and knowledge in use. Performance tasks requiring argumentation must capture the many ways students can construct and evaluate arguments in science, yet such tasks are both expensive and resource‐intensive to score. In this study we explore how machine learning text classification techniques can be applied to develop efficient, valid, and accurate constructed‐response measures of students' competency with written scientific argumentation that are aligned with a validated argumentation learning progression. Data come from 933 middle school students in the San Francisco Bay Area and are based on three sets of argumentation items in three different science contexts. The findings demonstrate that we have been able to develop computer scoring models that can achieve substantial to almost perfect agreement between human‐assigned and computer‐predicted scores. Model performance was slightly weaker for harder items targeting higher levels of the learning progression, largely due to the linguistic complexity of these responses and the sparsity of higher‐level responses in the training data set. Comparing the efficacy of different scoring approaches revealed that breaking down students' arguments into multiple components (e.g., the presence of an accurate claim or providing sufficient evidence), developing computer models for each component, and combining scores from these analytic components into a holistic score produced better results than holistic scoring approaches. However, this analytical approach was found to be differentially biased when scoring responses from English learners (EL) students as compared to responses from non‐EL students on some items. Differences in the severity between human and computer scores for EL between these approaches are explored, and potential sources of bias in automated scoring are discussed.
- 1 October 2013
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 50 (9) , 1127-1141
Conducting causal effects studies in science education: Considering methodological trade‐offs in the context of policies affecting research in schools
This paper focuses on the trade‐offs that lie at the intersection of methodological requirements for causal effect studies and policies that affect how and to what extent schools engage in such studies. More specifically, current federal funding priorities encourage large‐scale randomized studies of interventions in authentic settings. At the same time, policies that require schools to make adequate yearly progress (AYP) on state achievement tests make it risky for them to participate in trials of unproven interventions. Researchers attempting to balance rigorous study designs with the pressures felt by school districts must thoughtfully balance validity threats that are introduced in the negotiations with those districts. In this article, we draw on our experience conducting several randomized trials to discuss how these factors can be balanced. Specifically, we discuss necessary trade‐offs in causal effects studies related to statistical power, measurement sensitivity, research ethics, minimizing bias, and addressing the interests of all stakeholders. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50: 1127–1141, 2013
- 1 October 2013
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 50 (9) , 1127-1141
Conducting causal effects studies in science education: Considering methodological trade‐offs in the context of policies affecting research in schools
This paper focuses on the trade‐offs that lie at the intersection of methodological requirements for causal effect studies and policies that affect how and to what extent schools engage in such studies. More specifically, current federal funding priorities encourage large‐scale randomized studies of interventions in authentic settings. At the same time, policies that require schools to make adequate yearly progress (AYP) on state achievement tests make it risky for them to participate in trials of unproven interventions. Researchers attempting to balance rigorous study designs with the pressures felt by school districts must thoughtfully balance validity threats that are introduced in the negotiations with those districts. In this article, we draw on our experience conducting several randomized trials to discuss how these factors can be balanced. Specifically, we discuss necessary trade‐offs in causal effects studies related to statistical power, measurement sensitivity, research ethics, minimizing bias, and addressing the interests of all stakeholders. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50: 1127–1141, 2013