Susan M. Kowalski
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Susan M. Kowalski has a total of 66 co-authors. Here are the top co-authors by number of shared publications:
- Joseph A. Taylor
College of Education, University of Colorado Colorado Springs
5 shared publications Christopher D. Wilson
3 shared publications- Christopher D. Wilson
Biological Sciences Curriculum Study
2 shared publications - Elizabeth Tipton
Northwestern University
2 shared publications Janet Carlson
Stanford University
2 shared publicationsJoseph A. Taylor
Abt Associates Inc
2 shared publications
Latest Publications
- Open Access
- 11 July 2022
- Published by Elsevier in Social Sciences & Humanities Open
- Vol. 6 (1)
Addressing test fairness in education research: A process for quantifying the alignment between outcome measures and education interventions
- 11 July 2022
- Published by Elsevier in Social Sciences & Humanities Open
- Vol. 6 (1)
Open AccessAddressing test fairness in education research: A process for quantifying the alignment between outcome measures and education interventions
- 10 November 2021
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 59 (3) , 423-457
The effect of a student–teacher–scientist partnership program on high school students' science achievement and attitudes about scientists
This article describes the effects of a student–teacher–scientist partnership program on high school students' science outcomes. The design was a cluster‐randomized trial with an analytic sample of 36 teachers randomly assigned to teach a photosynthesis‐ and respiration‐focused module including student‐designed investigations supported by online mentoring from scientists. Forty‐nine teachers were randomly assigned to teach photosynthesis and respiration to students as they normally would. The core finding was that implementing the module in combination with the online mentoring resulted in significant effects on student achievement (effect size = 0.284) and attitudes toward scientists (effect size = 0.280). The study sample was highly representative, demographically, to the US population of high schools. Future research should replicate the current study design, with the current and other related interventions, while examining component‐specific costs and efficacy. Related studies should also examine the relationship between the quality of scientist–student dialogue and student outcomes.
- 10 November 2021
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 59 (3) , 423-457
The effect of a student–teacher–scientist partnership program on high school students' science achievement and attitudes about scientists
This article describes the effects of a student–teacher–scientist partnership program on high school students' science outcomes. The design was a cluster‐randomized trial with an analytic sample of 36 teachers randomly assigned to teach a photosynthesis‐ and respiration‐focused module including student‐designed investigations supported by online mentoring from scientists. Forty‐nine teachers were randomly assigned to teach photosynthesis and respiration to students as they normally would. The core finding was that implementing the module in combination with the online mentoring resulted in significant effects on student achievement (effect size = 0.284) and attitudes toward scientists (effect size = 0.280). The study sample was highly representative, demographically, to the US population of high schools. Future research should replicate the current study design, with the current and other related interventions, while examining component‐specific costs and efficacy. Related studies should also examine the relationship between the quality of scientist–student dialogue and student outcomes.
- Open Access
- 24 September 2021
- Published by Taylor & Francis in Journal of Science Teacher Education
- Vol. 32 (7) , 780-804
Developing Research-Based Instructional Materials to Support Large-Scale Transformation of Science Teaching and Learning: The Approach of the OpenSciEd Middle School Program
OpenSciEd is an ambitious effort to implement the vision of the Framework for K-12 Science Education and the Next Generation Science Standards broadly across the United States. The premise of OpenSciEd is that high quality instructional materials can play a critical role in transforming science teaching and learning at a broad scale. To achieve its goal, this collaborative project is developing instructional materials for middle school science that support the shifts in practice required to achieve the outcomes called for by the Framework for K-12 Science Education and the Next Generation Science Standards at a large scale. The OpenSciEd Middle School Program development project is addressing the challenge of making large changes in practice at a large scale through attention to (1) who participates in design and development, and how; (2) providing explicit guidance for developers in a comprehensive design framework; and (3) a design and development process that ensures participation from the desired participants and adherence to the guidelines of the design framework. The resulting instructional materials have shown promise in external reviews and field tests, but their success in achieving the project’s goals for transforming science will depend on the circumstances in which the program is implemented.
- 24 September 2021
- Published by Taylor & Francis in Journal of Science Teacher Education
- Vol. 32 (7) , 780-804
Open AccessDeveloping Research-Based Instructional Materials to Support Large-Scale Transformation of Science Teaching and Learning: The Approach of the OpenSciEd Middle School Program
OpenSciEd is an ambitious effort to implement the vision of the Framework for K-12 Science Education and the Next Generation Science Standards broadly across the United States. The premise of OpenSciEd is that high quality instructional materials can play a critical role in transforming science teaching and learning at a broad scale. To achieve its goal, this collaborative project is developing instructional materials for middle school science that support the shifts in practice required to achieve the outcomes called for by the Framework for K-12 Science Education and the Next Generation Science Standards at a large scale. The OpenSciEd Middle School Program development project is addressing the challenge of making large changes in practice at a large scale through attention to (1) who participates in design and development, and how; (2) providing explicit guidance for developers in a comprehensive design framework; and (3) a design and development process that ensures participation from the desired participants and adherence to the guidelines of the design framework. The resulting instructional materials have shown promise in external reviews and field tests, but their success in achieving the project’s goals for transforming science will depend on the circumstances in which the program is implemented.
- 6 April 2020
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 13 (3) , 430-458
Examining Factors Contributing to Variation in Effect Size Estimates of Teacher Outcomes from Studies of Science Teacher Professional Development
Developing and maintaining a high-quality science teaching corps has become increasingly urgent with standards that require students to move beyond mastering facts to reasoning and arguing from evidence. Effective professional development (PD) for science teachers enhances teacher outcomes and, in turn, enhances primary and secondary student outcomes. What constitutes effective PD? Although proposed features of effective PD have emerged, they have little empirical support. Even when impact studies of PD interventions are conducted, factors unrelated to PD design characteristics can influence effect size estimates. Can we statistically isolate PD design characteristics from factors unrelated to PD design that nevertheless influence effect size estimates? We conducted a meta-regression with robust variance estimation (RVE) of 162 science PD intervention studies. We investigated how effect size estimates for teacher outcomes vary by research design, study context, PD intervention characteristics, and outcomes of interest. Intensity and duration of PD, research design decisions, and researchers’ choice of outcomes of interest significantly influence effect size estimates.
- 6 April 2020
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 13 (3) , 430-458
Examining Factors Contributing to Variation in Effect Size Estimates of Teacher Outcomes from Studies of Science Teacher Professional Development
Developing and maintaining a high-quality science teaching corps has become increasingly urgent with standards that require students to move beyond mastering facts to reasoning and arguing from evidence. Effective professional development (PD) for science teachers enhances teacher outcomes and, in turn, enhances primary and secondary student outcomes. What constitutes effective PD? Although proposed features of effective PD have emerged, they have little empirical support. Even when impact studies of PD interventions are conducted, factors unrelated to PD design characteristics can influence effect size estimates. Can we statistically isolate PD design characteristics from factors unrelated to PD design that nevertheless influence effect size estimates? We conducted a meta-regression with robust variance estimation (RVE) of 162 science PD intervention studies. We investigated how effect size estimates for teacher outcomes vary by research design, study context, PD intervention characteristics, and outcomes of interest. Intensity and duration of PD, research design decisions, and researchers’ choice of outcomes of interest significantly influence effect size estimates.
- Open Access
- 18 March 2019
- Published by Wiley in Science Education
- Vol. 103 (3) , 529-560
Toward a more humane genetics education: Learning about the social and quantitative complexities of human genetic variation research could reduce racial bias in adolescent and adult populations
When people are exposed to information that leads them to overestimate the actual amount of genetic difference between racial groups, it can augment their racial biases. However, there is apparently no research that explores if the reverse is possible. Does teaching adolescents scientifically accurate information about genetic variation within and between US census races reduce their racial biases? We randomized 8th and 9th grade students (n = 166) into separate classrooms to learn for an entire week either about the topics of (a) human genetic variation or (b) climate variation. In a cross‐over randomized trial with clustering, we demonstrate that when students learn about genetic variation within and between racial groups it significantly changes their perceptions of human genetic variation, thereby causing a significant decrease in their scores on instruments assessing cognitive forms of prejudice. We then replicate these findings in two computer‐based randomized controlled trials, one with adults (n = 176) and another with biology students (n = 721, 9th–12th graders). These results indicate that teaching about human variation in the domain of genetics has potentially powerful effects on social cognition during adolescence. In turn, we argue that learning about the social and quantitative complexities of human genetic variation research could prepare students to become informed participants in a society where human genetics is invoked as a rationale in sociopolitical debates.
- 18 March 2019
- Published by Wiley in Science Education
- Vol. 103 (3) , 529-560
Open AccessToward a more humane genetics education: Learning about the social and quantitative complexities of human genetic variation research could reduce racial bias in adolescent and adult populations
When people are exposed to information that leads them to overestimate the actual amount of genetic difference between racial groups, it can augment their racial biases. However, there is apparently no research that explores if the reverse is possible. Does teaching adolescents scientifically accurate information about genetic variation within and between US census races reduce their racial biases? We randomized 8th and 9th grade students (n = 166) into separate classrooms to learn for an entire week either about the topics of (a) human genetic variation or (b) climate variation. In a cross‐over randomized trial with clustering, we demonstrate that when students learn about genetic variation within and between racial groups it significantly changes their perceptions of human genetic variation, thereby causing a significant decrease in their scores on instruments assessing cognitive forms of prejudice. We then replicate these findings in two computer‐based randomized controlled trials, one with adults (n = 176) and another with biology students (n = 721, 9th–12th graders). These results indicate that teaching about human variation in the domain of genetics has potentially powerful effects on social cognition during adolescence. In turn, we argue that learning about the social and quantitative complexities of human genetic variation research could prepare students to become informed participants in a society where human genetics is invoked as a rationale in sociopolitical debates.
- Open Access
- 1 July 2018
- Published by SAGE Publications in AERA Open
- Vol. 4 (3)
Investigating Science Education Effect Sizes: Implications for Power Analyses and Programmatic Decisions
A priori power analyses allow researchers to estimate the number of participants needed to detect the effects of an intervention. However, power analyses are only as valid as the parameter estimates used. One such parameter, the expected effect size, can vary greatly depending on several study characteristics, including the nature of the intervention, developer of the outcome measure, and age of the participants. Researchers should understand this variation when designing studies. Our meta-analysis examines the relationship between science education intervention effect sizes and a host of study characteristics, allowing primary researchers to access better estimates of effect sizes for a priori power analyses. The results of this meta-analysis also support programmatic decisions by setting realistic expectations about the typical magnitude of impacts for science education interventions.
- 1 July 2018
- Published by SAGE Publications in AERA Open
- Vol. 4 (3)
Open AccessInvestigating Science Education Effect Sizes: Implications for Power Analyses and Programmatic Decisions
A priori power analyses allow researchers to estimate the number of participants needed to detect the effects of an intervention. However, power analyses are only as valid as the parameter estimates used. One such parameter, the expected effect size, can vary greatly depending on several study characteristics, including the nature of the intervention, developer of the outcome measure, and age of the participants. Researchers should understand this variation when designing studies. Our meta-analysis examines the relationship between science education intervention effect sizes and a host of study characteristics, allowing primary researchers to access better estimates of effect sizes for a priori power analyses. The results of this meta-analysis also support programmatic decisions by setting realistic expectations about the typical magnitude of impacts for science education interventions.
- 16 January 2018
- Published by Springer Nature in Journal of Science Education and Technology
- Vol. 27 (4) , 285-305
Teacher Implementation and the Impact of Game-Based Science Curriculum Materials
- 16 January 2018
- Published by Springer Nature in Journal of Science Education and Technology
- Vol. 27 (4) , 285-305
Teacher Implementation and the Impact of Game-Based Science Curriculum Materials
- 27 April 2016
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 53 (8) , 1216-1231
Emergent themes from recent research syntheses in science education and their implications for research design, replication, and reporting practices
- 27 April 2016
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 53 (8) , 1216-1231
Emergent themes from recent research syntheses in science education and their implications for research design, replication, and reporting practices
- 1 October 2015
- Published by American Educational Research Association (AERA) in American Educational Research Journal
- Vol. 52 (5) , 984-1017
An Efficacy Trial of Research-Based Curriculum Materials With Curriculum-Based Professional Development
This study examined the efficacy of a curriculum-based intervention for high school science students. Specifically, the intervention was two years of research-based, multidisciplinary curriculum materials for science supported by comprehensive professional development for teachers that focused on those materials. A modest positive effect was detected when comparing outcomes from this intervention to those of business-as-usual materials and professional development. However, this effect was typical for interventions at this grade span that are tested using a state achievement test. Tests of mediation suggest a large treatment effect on teachers and in turn a strong effect of teacher practice on student achievement—reinforcing the hypothesized key role of teacher practice. Tests of moderation indicate no significant treatment by demographic interactions.
- 1 October 2015
- Published by American Educational Research Association (AERA) in American Educational Research Journal
- Vol. 52 (5) , 984-1017
An Efficacy Trial of Research-Based Curriculum Materials With Curriculum-Based Professional Development
This study examined the efficacy of a curriculum-based intervention for high school science students. Specifically, the intervention was two years of research-based, multidisciplinary curriculum materials for science supported by comprehensive professional development for teachers that focused on those materials. A modest positive effect was detected when comparing outcomes from this intervention to those of business-as-usual materials and professional development. However, this effect was typical for interventions at this grade span that are tested using a state achievement test. Tests of mediation suggest a large treatment effect on teachers and in turn a strong effect of teacher practice on student achievement—reinforcing the hypothesized key role of teacher practice. Tests of moderation indicate no significant treatment by demographic interactions.
- 1 October 2013
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 50 (9) , 1127-1141
Conducting causal effects studies in science education: Considering methodological trade‐offs in the context of policies affecting research in schools
This paper focuses on the trade‐offs that lie at the intersection of methodological requirements for causal effect studies and policies that affect how and to what extent schools engage in such studies. More specifically, current federal funding priorities encourage large‐scale randomized studies of interventions in authentic settings. At the same time, policies that require schools to make adequate yearly progress (AYP) on state achievement tests make it risky for them to participate in trials of unproven interventions. Researchers attempting to balance rigorous study designs with the pressures felt by school districts must thoughtfully balance validity threats that are introduced in the negotiations with those districts. In this article, we draw on our experience conducting several randomized trials to discuss how these factors can be balanced. Specifically, we discuss necessary trade‐offs in causal effects studies related to statistical power, measurement sensitivity, research ethics, minimizing bias, and addressing the interests of all stakeholders. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50: 1127–1141, 2013
- 1 October 2013
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 50 (9) , 1127-1141
Conducting causal effects studies in science education: Considering methodological trade‐offs in the context of policies affecting research in schools
This paper focuses on the trade‐offs that lie at the intersection of methodological requirements for causal effect studies and policies that affect how and to what extent schools engage in such studies. More specifically, current federal funding priorities encourage large‐scale randomized studies of interventions in authentic settings. At the same time, policies that require schools to make adequate yearly progress (AYP) on state achievement tests make it risky for them to participate in trials of unproven interventions. Researchers attempting to balance rigorous study designs with the pressures felt by school districts must thoughtfully balance validity threats that are introduced in the negotiations with those districts. In this article, we draw on our experience conducting several randomized trials to discuss how these factors can be balanced. Specifically, we discuss necessary trade‐offs in causal effects studies related to statistical power, measurement sensitivity, research ethics, minimizing bias, and addressing the interests of all stakeholders. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50: 1127–1141, 2013