JSJohn Stewart

John Stewart

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


John Stewart has a total of 62 co-authors. Here are the top co-authors by number of shared publications:

  • Gay Stewart

    West Virginia University, Department of Physics and Astronomy, Morgantown, West Virginia 26506, USA

    11 shared publications
  • Rachel Henderson

    Department of Physics and Astronomy, Michigan State University, East Lansing, Michigan 48824, USA

    10 shared publications
  • Cabot Zabriskie

    Department of Physics and Astronomy, West Virginia University, Morgantown, West Virginia 26506, USA

    8 shared publications
  • Jie Yang

    Department of Physics and Astronomy, West Virginia University, Morgantown, West Virginia 26506, USA

    8 shared publications
  • Seth DeVore

    Department of Physics and Astronomy, West Virginia University, Morgantown, West Virginia 26506, USA

    7 shared publications
  • Paul Miller

    West Virginia University, Department of Physics and Astronomy, Morgantown, West Virginia 26506, USA

    6 shared publications

Latest Publications

  • Open Access

    Examining factors influencing the development and evolution of self-efficacy and sense of belonging in a physics class

    by Danielle Maldonado, John Stewart

    This study analyzed the relation between self-efficacy (SE) and sense of belonging (BL) in introductory physics courses by measuring these variables at two time points, early in the semester and midsemester. The study was performed in the introductory, calculus-based mechanics class at a large university in the United States and includes 1373 complete records. An extensive set of Observed Prior Causes (OPCs), including Force and Motion Conceptual Evaluation pretest scores, college and high school preparation variables, high school physics and math variables, personality variables, and demographics, were found to be predictive of SE or BL. Early in the semester, SE and BL were highly correlated ( r = 0.56 ); after controlling for OPCs, r = 0.37 of this correlation remained. SE fully explained the relation of BL to midsemester test average, while OPCs fully explained the relation of SE to test average. Changes to SE and BL in response to course feedback in the form of test averages were also explored. Test average explained little of the relation between early and midsemester SE or BL. The analysis supported a model where test average predicted midsemester SE, which in turn predicted midsemester BL. Mediation analysis found both directed and correlational paths were important in explaining the complex relation of these variables. Some moderation effects were detected, but were generally small.

  • Open Access

    Extending curricular analytics to analyze undergraduate physics programs

    by John Hansen, Amanda Nemeth, John Stewart

    Curricular analytics (CA) is a quantitative method that analyzes the sequence of courses (curriculum) that students in an undergraduate academic program must complete to fulfill the requirements of the program. The main hypothesis of CA is that the less complex a curriculum is, the more likely it is that students complete the program. This study compares the curricular complexity of undergraduate physics programs at 60 institutions in the United States. The institutions were divided into three tiers based on national rankings of the physics graduate program, and the means of each tier were compared. No significant difference between the means of each tier was found, indicating that there is not a relationship between program curricular complexity and program ranking. Further analysis focused on the physics, chemistry, and mathematics courses, defined as the core courses of the curriculum. Significant differences in the number of required core courses and the complexity per core course were measured between the tiers; both were measured as large effects. Programs with the highest rankings required fewer core courses while having a higher complexity per core course. These institutions have more strict prerequisite requirements than lower ranking programs. This study also showed complexity was quantitatively related to curricular flexibility operationalized as the number of available eight-semester degree plans. The number of available degree plans exponentially decreased with increasing core complexity per course. Modifications to a curriculum at one institution were analyzed; a similar relationship between the number of available degree plans and increasing complexity per core course was found. Published by the American Physical Society 2024


  • Open Access

    Comparing the evolution of self-regulated learning behaviors to academic performance, personality, and self-efficacy in the introductory physics classroom

    by Danielle Maldonado, John Stewart

    Self-regulated learning (SRL) is a cognitive and metacognitive process through which students develop the self-awareness necessary to direct their learning based on their needs to reach a desired outcome. Despite 40 years of literature, SRL has no singular definition, as it is often used in domain-specific research that is not always transferable to other fields. Regardless, much of the literature speaks to the importance of SRL regarding academic success. This paper details the development of an SRL instrument designed to identify key self-regulatory constructs in an undergraduate introductory physics classroom. Confirmatory factor analysis supported a four-factor model measuring Planning, Time & Environment Management, Comprehension Monitoring & Evaluation, and Peer Learning & Help-Seeking as unique facets of self-regulated learning. While most behaviors did not significantly evolve over one semester, students reported significantly lower scores on the Comprehension Monitoring & Evaluation factor between the beginning and end of the semester. Higher performing students, as measured by their average homework grades, scored significantly higher on the Time & Environment Management factor and the Peer Learning & Help-Seeking factor at both time points. Additionally, SRL behaviors were significantly predicted by personality facets from the Big Five Inventory, with Conscientiousness, Extraversion, and Openness being the most related to certain behaviors.

  • Open Access

    Exploring techniques to improve machine learning’s identification of at-risk students in physics classes

    by John Pace, John Hansen, John Stewart

    Machine learning models were constructed to predict student performance in an introductory mechanics class at a large land-grant university in the United States using data from 2061 students. Students were classified as either being at risk of failing the course (earning a D or F) or not at risk (earning an A, B, or C). The models focused on variables available in the first few weeks of the class which could potentially allow for early interventions to help at-risk students. Multiple types of variables were used in the model: in-class variables (average homework and clicker quiz scores), institutional variables [college grade point average (GPA)], and noncognitive variables (self-efficacy). The substantial imbalance between the pass and fail rates of the course, with only about 10% of students failing, required modification to the machine learning algorithms. Decision threshold tuning and upsampling were successful in improving performance for at-risk students. Logistic regression combined with a decision threshold tuned to maximize balanced accuracy yielded the strongest classifier, with a DF accuracy of 83% and an ABC accuracy of 81%. Measures of variable importance involving changes in balanced accuracy identified homework grades, clicker grades, college GPA, and the fraction of college classes successfully completed as the most important variables in predicting success in introductory physics. Noncognitive variables added little predictive power to the models. Classification models with performance near the best-performing models using the full set of variables could be constructed with very few variables (homework average, clicker scores, and college GPA) using straightforward to implement algorithms, suggesting the application of these technologies may be fairly easy to include in many physics classes. Published by the American Physical Society 2024


  • Open Access

    Beyond normalized gain: Improved comparison of physics educational outcomes

    by Elaine Christman, Paul Miller, John Stewart

    This study proposes methods of reporting results of physics conceptual evaluations that more fully characterize the range of outcomes experienced by students with differing levels of prior preparation, allowing for more meaningful comparison of the outcomes of educational interventions within and across institutions. Factors leading to variation in post-test scores on the Force and Motion Conceptual Evaluation (FMCE) across different instructors, semesters, and course models in a sample collected in introductory calculus-based mechanics at a large, eastern land-grant university were examined. The sample was collected over nine years and contains a total of N=4409 matched pretest and post-test records. The data showed a systematic semester-by-semester variation in both pretest scores and ACT or SAT mathematics percentile scores. Neither the normalized gain nor Cohen’s d removed the semester-to-semester variation observed in post-test scores. The local average curve plotting post-test scores against pretest scores, which we call a conceptual growth curve, allowed for the characterization of outcomes for students with different pretest scores. Regression models were used to produce an approximation to this curve. By using either the full curve or a mathematical approximation developed through linear regression, the post-test score that would be observed if a class enrolled students with a given level of prior preparation measured by pretest scores can be predicted. This predicted post-test score can then be used to calculate the predicted normalized gain if desired. These methods rely on using the natural variation of incoming student preparation at one institution to predict how a class would perform if it enrolled students with different prior preparation. The study presents an example of converting the outcomes at an institution with a weakly prepared student population to the outcomes which would have been observed if the course enrolled a more prepared student population; converting the outcomes for a different student population dramatically changed the interpretation of how the class studied was functioning.


  • Open Access

    Applying module analysis to the Brief Electricity and Magnetism Assessment

    by Christopher Wheatley, James Wells, John Stewart

    The Brief Electricity and Magnetism Assessment (BEMA) is a multiple-choice instrument commonly used to measure introductory undergraduate students’ conceptual understanding of electricity and magnetism. This study used a network analysis technique called modified module analysis-partial (MMA-P) to identify clusters of correlated responses, also known as communities, within 12214 BEMA responses. MMA-P identifies both communities related to the structure of the instrument and communities related to incorrect student reasoning. Every community resulting from MMA-P came from blocked items; groups of items that all refer to the same physical system. The most prevalent and consistently selected incorrect answers involved the relation of the electric field to the electric potential difference. The community structure identified in the Conceptual Survey of Electricity and Magnetism (CSEM) by a prior MMA-P study on items shared by the CSEM and BEMA differed because of the different incorrect responses available in the two instruments. One pair of items in the BEMA involving the induced electric field by a changing magnetic field showed evidence of students applying a variety of incorrect models; the scores on these items indicate their inclusion in the instrument should be reconsidered. Published by the American Physical Society 2024


  • Open Access

    Adding self-regulated learning instruction to an introductory physics class

    by Danielle Maldonado, John Stewart

    Self-regulated learning (SRL) is an essential factor in academic success. Self-regulated learning is a process where learners set clear goals, monitor progress toward attainment of those goals, and adapt their strategies to improve their learning. Because SRL is often not explicitly integrated into the classroom, students struggle to identify and use learning techniques empirically proven to be more successful than others. SRL is a learned skill students can develop over time that has been found to be related to high achievement and self-efficacy. This paper examines the effects of introducing SRL strategies into an undergraduate introductory physics classroom. The degree to which the students were self-regulated learners was correlated with their test averages (r = 0.23, p < 0.05). Students reported that they found the SRL instruction helpful (3.5 out of 5.0 on a 5-point scale) and 86% of the students felt the time spent on the instruction was generally appropriate. Students' preferred study methods changed over the course of the semester, indicating that students applied SRL by adapting their learning processes based on which methods were most effective in helping them study for an upcoming exam and opting not to use techniques no longer perceived as useful. Higher achieving students were more likely to settle on highly effective techniques by the end of the semester, while lower achieving students continued to modify their learning processes.


  • Open Access

    Comparing introductory undergraduate physics learning and behavior before and after the COVID-19 pandemic

    by Amanda Nemeth, Christopher Wheatley, John Stewart

    This study examines high school preparation measures [ACT/SAT scores, high school grade point average (HSGPA), and conceptual physics pretest scores], in-class behavior measures (homework submission rates and lecture attendance rates), and in-class achievement measures (homework and test averages) for the last two fully face-to-face prepandemic and the first two fully face-to-face postpandemic semesters of an introductory calculus-based electricity and magnetism class. This class was offered at a large eastern land grant university in the United States. The total number of students for the four semesters was 1033. While some significant differences were measured (higher postpandemic HSGPA, lower postpandemic conceptual pretest scores, higher postpandemic homework average (fall semesters only), and lower postpandemic lecture attendance (spring semesters only), none were larger than a small effect. As such, student achievement, attendance rates, and assignment completion rates were largely unchanged after the pandemic.


  • Quantitative Methods in PER

    by John Stewart, John Hansen, Lin Ding

    Quantitative research methods have a rich history in Physics Education Research (PER). This chapter takes the reader through some of that history and outlines the most commonly used methods in the field including inferential and descriptive statistics, hypothesis testing, Type I and Type II error, classical test theory, factor analysis, item response theory, linear and logistic regression, hierarchical linear modeling, structural equation modeling, cluster analysis, machine learning, and network analysis. A short description of each technique is provided followed by a brief summary of some the studies within PER that have applied the method.

  • Open Access

    Comparing conceptual understanding across institutions with module analysis

    by Christopher Wheatley, James Wells, David E. Pritchard, John Stewart

    The Force Concept Inventory (FCI) is a popular multiple-choice instrument used to measure a student’s conceptual understanding of Newtonian mechanics. Recently, a network analytic technique called module analysis has been used to identify responses to the FCI and other conceptual instruments that are preferentially selected together by students; these groups of responses are called communities. This study uses module analysis to explore the misconception structure of the FCI at five U.S. institutions with varying undergraduate populations (sample sizes of N=9606, 4360, 1496, 466, and 213). Students from these universities had a broad range of prior knowledge in physics and of general high school academic preparation, resulting in large differences in FCI normalized gain, pretest, and post-test scores. In the current work, modified module analysis partial was applied and communities of consistently selected responses within the FCI were identified at the five institutions studied. There was substantial similarity between the communities identified postinstruction; somewhat less similarity preinstruction. This suggests that consistently applied Newtonian misconceptions exist both before and after instruction at a wide range of institutions. The most frequently applied misconceptions were “largest force determines motion,” Newton’s third law misconceptions, and “motion implies active forces.” These misconceptions were still consistently applied even after instruction by a substantial number of students at all but the highest performing of the five institutions.