NHNatasha G. Holmes

Natasha G. Holmes

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Natasha G. Holmes has a total of 101 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Open- versus closed-response methods of measuring students’ reasoning: A case study using the Physics Measurement Questionnaire

    by Rebeckah K. Fussell, Jillian S. Epstein, Gina Passante, N. G. Holmes

    We compare open- and closed-response versions of two questions that measure students’ reasoning on the Physics Measurement Questionnaire, same mean different spread (SMDS), and different mean same spread (DMSS). We conducted an experiment in one class ( N = 248 ) to test if asking students for their reasoning on an open-response question changes their answer to the closed-response question. To test whether answering the open-response question alters students’ closed-response answers, we prompted half of the students to explain their reasoning before seeing the closed-response options, while the other half went straight to the closed-response reasoning options. We find no effect of asking students their reasoning in an open-response question on their subsequent closed-response answers. Additionally, we investigated whether we measure students’ reasoning differently on the closed-response versus open-response versions of the question by evaluating the consistency between the students’ open-response and closed-response answers. Although we measure similarities in students’ reasoning across the two methods, the differences indicate that the open-response and closed-response questions provide different information. The results inform the need for critical judgment when deciding between open- and closed-response assessment formats.

  • Research on physics education where physics education happens

    by Drew J. Rosen, Paula R. L. Heron, N. G. Holmes


  • Open Access

    Predictive Modeling for High Impact Active Learning Classrooms

    by Olive Ross, Meagan Sundstrom, N. Holmes

    Over the past several decades, a large body of research has shown that undergraduate science students learn more and more equitably in active learning classrooms; however, the term “active learning” lacks definition and little research has examined which types and combinations of active learning strategies are most effective. In this study, we use a dataset representing over 10,000 students and 24 institutions to create a predictive model that maps classroom time spent on different activities to student conceptual learning. We find that four variables -- classroom time spent on lecture, group worksheets, clicker questions, and student questions -- are sufficient to reliably predict student learning, as measured by concept inventory scores. We identify one type of class that consistently demonstrates exceptional student learning gains (effect sizes greater than 2): those that spend 10-20\% of class time on group worksheets, 20-40\% of class time on group clicker questions, and average two or more student questions per hour of class time. We also find that classes which do not utilize group worksheets consistently have learning outcomes comparable to fully lecture classes. These results provide testable recommendations for future controlled studies to investigate effective active learning implementation in undergraduate physics courses.

  • Open Access

    Lessons from pendulums: A design comparison of three lab activities

    by Ian Descamps, Roger Tobin, Paul Wagoner, David Hammer, N. G. Holmes, Rachel E. Scherr

    We present three versions of a pendulum lab activity to explore how theoretical commitments, motivations, and aspirations are reflected in curriculum design. In earlier work, Boudreaux and Elby [How curriculum developers’ cognitive theories influence curriculum development, ] discussed how different theoretical perspectives led them to different designs of tutorials. Here, we discuss our finding that even starting from the same theoretical perspective and having similar goals for students can lead to differences in design. We give three interacting reasons why our labs diverge: We have different expectations of students at our respective institutions; we have different ancillary goals; and we draw different implications from our shared theoretical commitments. Our account demonstrates the complexity of the relationship between theory, goals, and curriculum design. In this way, it adds to prior arguments for the importance of designers’ articulating the reasoning for their choices as well as for the possible value of instructors’ responsive adaptations to curricula.


  • Open Access

    Share, rotate, split: The effects of group work role distributions on student outcomes

    by Jacob Feinleib, Matthew Dew, N. G. Holmes

    Education literature recommends many different strategies for structuring student group work in labs. Many of these strategies, however, have not been sufficiently evaluated for their effects on student outcomes. One prior study suggested that sharing roles, rather than splitting roles, in lab groups can boost students’ physics interest and self-efficacy. Here, we expand upon this literature by evaluating the effects of a broader range of role distributions across several student outcomes in a large sample at two different institutions. We developed a survey item to probe the ways in which students distribute their roles in lab groups. The item asks for the percent of time in lab that students spent working together on lab roles (sharing), working alone on roles but rotating each session (rotating), and working alone in the same role throughout the semester (splitting). We employed hierarchical linear modeling to measure the effects of these role distributions on student critical thinking, self-efficacy, perceived agency, sense of belonging, and recognition based on survey items specific to physics lab contexts. We found that role distributions did not differentially impact student critical thinking. We also found that sharing roles tended to have a positive impact on student attitudes; splitting had a negative effect on attitudes; and rotating fell in between. Statistical significance varied across these attitudinal outcomes. Our findings invite further research and controlled studies to better understand the apparent benefits of sharing, rotating, and splitting roles in introductory physics labs.

  • Open Access

    Structuring groups for gender equitable equipment usage in labs

    by Matthew Dew, Emily M. Stump, N. G. Holmes

    Previous research has found gender inequitable equipment usage across various lab course contexts. Few studies, however, have tested possible remediation strategies. In this work, we use hierarchical linear modeling to compare men and women’s lab equipment usage in two group work structures across three course contexts. In one in-person course, students formed their own groups in class and rotated into new groups every unit. In the other two courses, one in person and one remote, students were assigned groups formed by the instructor and worked with the same group all semester. In line with former studies, we found gender inequitable equipment usage in the course with in-class formed, rotated groups. We did not observe gender inequitable equipment usage, however, in the course with instructor-assigned, fixed groups. Analyzing equipment usage across the semester within each course, our results suggest that this improvement comes from a combination of both instructor-assigned groups and keeping groups fixed for the semester. Our findings present many opportunities for subsequent controlled studies to probe these practices.


  • Open Access

    Perceptions of interdisciplinary critical thinking among biology and physics undergraduates

    by Ashley B. Heim, Georgia Lawrence, Riya Agarwal, Michelle K. Smith, N. G. Holmes

    There is a growing need for more effective interdisciplinary science instruction across undergraduate degree programs. In addition to supporting students’ connections between disciplinary concepts, interdisciplinary learning can develop students’ critical thinking skills and allow them to evaluate scientific investigations and claims between diverse topics. Physics Education Research literature has particularly focused on introductory physics courses for life sciences students, in part because students majoring in life sciences represent one of the largest demographics enrolled in physics courses. This literature has primarily focused on students’ development of conceptual understanding, modeling skills, and perspectives of the two fields. In this study, we explored how biology and physics undergraduates approach and perceive critical thinking between the two disciplines. We conducted structured think-aloud interviews with biology and physics students, asking students to first complete portions of established biology and physics critical thinking assessments and then respond to several follow-up questions about critical thinking more generally. Using thematic analysis to inductively code interview responses into emergent themes, we found that most students, regardless of major, described different approaches to evaluating biology and physics experiments. However, physics students provided similar definitions of critical thinking in the two disciplines, while biology students provided similar and different definitions in almost equal numbers. The exception was related to the use of quantitative methods solely being associated with critical thinking in physics, despite both critical thinking assessments involving quantitative data analysis. When looking across constructs, we saw no clear trends or relationships between individual students’ responses to each of the interview questions. We also explored students’ broader perspectives on the two fields and found that physics students assume that physics is needed to understand biology but not vice versa, which did not align with their perspectives on critical thinking between disciplines. We use this complexity to motivate future work to understand the impact of biology and physics instruction, as well as other STEM disciplines, on developing students’ critical thinking skills and perceptions.


  • Open Access

    Comparing large language models for supervised analysis of students’ lab notes

    by Rebeckah K. Fussell, Megan Flynn, Anil Damle, Michael F. J. Fox, N. G. Holmes

    Recent advancements in large language models (LLMs) hold significant promise for improving physics education research that uses machine learning. In this study, we compare the application of various models for conducting a large-scale analysis of written text grounded in a physics education research classification problem: identifying skills in students’ typed lab notes through sentence-level labeling. Specifically, we use training data to fine-tune two different LLMs, BERT and LLaMA, and compare the performance of these models to both a traditional bag-of-words approach and a few-shot LLM (without fine-tuning). We evaluate the models based on their resource use, performance metrics, and research outcomes when identifying skills in lab notes. We find that higher-resource models often, but not necessarily, perform better than lower-resource models. We also find that all models report similar trends in research outcomes, although the absolute values of the estimated measurements are not always within uncertainties of each other. We use the results to discuss relevant considerations for education researchers seeking to select a model type for use as a classifier.