AHAndrew F. Heckler

Andrew F. Heckler

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Andrew F. Heckler has a total of 43 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Does presentation matter? Examining show-work presentation quality and student performance in introductory physics

    by Heather Mei, Qiaoyi Liu, Kentaro Fujita, Andrew F. Heckler

    Physics problem-solving assessments often prioritize accuracy over presentation. However, the presentation quality of a student’s written solution—such as its handwriting clarity and layout—may play an important role both as an indicator and facilitator of student problem-solving and achievement. In this study, we investigated the relationships between show-work presentation (SWP), conscientiousness, and student performance in a large-enrollment introductory calculus-based physics course. Using an emergent coding process, we first iteratively developed a reliable rubric for quantifying several presentation qualities of student solutions to two introductory mechanics final exam show-work questions. We found that the coding produced scores for 2 orthogonal factors, which we label as Form, measuring layout and legibility, and Annotation, measuring student notation of their work. Statistical analyses showed that Form was a moderate-to-weak positive predictor of various course performance measures ( r ∼ 0.3 ), including show-work score, exam score, nonexam scores, and course grade. Even when controlling for ACT Math and conscientiousness scores, Form still accounted for 4%–5% of the variance of these course performance scores. In contrast, Annotation was at best very weakly and inconsistently (in sign) correlated with these performance scores. Sex differences were also observed, with female students’ mean scores for both Form and Annotation typically about one-half standard deviation higher than male students’ scores. Simultaneous mediation models of the relation between sex and course outcomes included the mediators of ACT score, conscientiousness, and Form. Results indicate that Form partially mediated the relation between sex and course grade, show-work score, multiple-choice score, and nonexam score. Specifically, women tended to score higher on Form, and this effect in turn led to a positive effect on scores on all of these outcomes, typically compensating for other negative effects. The (simultaneous) mediations of ACT score and conscientiousness were much weaker, consistent with being vanishingly small. It is important to note that these are correlational results only, and control-treatment designs are called for to investigate potential causal links between Form and performance. Overall, by developing and implementing a validated rubric measuring show-work presentation quality, we find evidence that presentation quality may play a relatively small but reliable role in student performance on show-work problems and is a weak but reliable predictor of most components of course performance. These results suggest that show-work presentation may be an important factor to consider in physics instruction.

  • Open Access

    How do you measure a threat in the air? Testing the universal, dynamic, and multifaceted nature of social identity threat

    by Kathryn M. Kroeper, Ariana Hernandez-Colmenares, Dorainne J. Green, Heidi E. Williams, Austin Kuzdal, Juan Ospina, Courtney A. Moore, Gunjan Agarwal, Andrew F. Heckler, Jennifer Crocker, et al.

    Social identity threat is a vigilance state in which a person anticipates that others in a setting may devalue them because of one (or more) of their social identities. According to theory, threat is multifaceted—encompassing concerns about stereotyping, belonging, fairness, authenticity, and more—and situational, fluctuating depending on which identities and contextual cues are salient. Threat is also theorized as a universal experience—affecting potentially anyone, across any of their identities. Here, we put these central aspects of theory to the test by introducing the Social Identity Threat Concerns (SITC) Inventory, a self-report instrument designed to assess threat across varied identity-by-context situations. Across nine studies ( N = 8533), we show that threat is common across social groups yet situational, emerging under specific, theorized conditions. The SITC Inventory is a field-advancing tool that equips researchers to better understand and reduce identity-based threats, laying the groundwork for more inclusive and equitable environments.


  • Open Access

    Response time on math skills and its association with math skills accuracy and physics course grades

    by Harish Moni Prakash, Andrew F. Heckler

    Accuracy on assessments is commonly studied in education research but response time (RT) is relatively less investigated even though decades of research in cognitive sciences indicate that time can be an important dimension for understanding student learning. To better understand RT and the potentially important relations between accuracy and RT in physics education, we conducted an exploratory investigation by collecting and analyzing both accuracy and RT data on physics-relevant math skills on low-stakes pre and posttests as well as course exam scores in algebra-based and calculus-based introductory physics courses over two semesters for a total of N = 1 9 3 6 participants. Overall, we found a high level of variation in response times revealing weak but consistent patterns of associations between RT and accuracy on skills and exam scores. First, we found a nonlinear relationship between RT and accuracy on the pretest and on the post-test, which may indicate a variety of strategies and engagement among students on these participation-credit-only tests. Second, the results indicate that while RT alone does not predict course grade, when controlling for accuracy on pre or posttest math skills, students with lower RT on these skills are more likely to get better grades. Therefore, both pre or posttest accuracy and speed predicted course grades, though accuracy explained a substantial amount of variance ( ∼ 35 % ) while pretest RT explained a much smaller amount of variance ( ∼ 1 % ). Third, controlling for both pretest accuracy and pretest RT, we found that students who sped up from pre to posttest were likely to get higher exam scores; however, students who slowed down were on average likely to have a higher post-test score. Fourth, since systemic inequities in STEM education have been documented via measured mean differences between some demographic groups for exam scores and accuracy on math skills, we compared RTs by sex, race, first-generation status, and citizenship to potentially gain more insight into these inequities. We found no consistent or conclusive evidence of demographic differences, though in multiple comparisons, Black, Hispanic, Native American, and Pacific Islander students had larger RTs on average, and in one comparison they were slightly faster. We found that RT was not a mediator of demographic differences in physics grades, though, as expected, accuracy on math skills was a mediator. We briefly discuss how our results relate to various cognitive models such as cognitive ability, speed-accuracy trade-offs, fluency and cognitive load, dual-process theories, and student psychological factors like self-efficacy, anxiety, and motivation. We argue that, based on which (if any) of the above mechanisms are at play, valuing speed in physics may have benefits, such as improving fluency to reduce cognitive load and drawbacks, such as unintentionally using speed as a proxy for achievement or inducing excessive stress that may interfere with performance and student well-being.


  • Open Access

    Algebra and other relevant physics skills: The effectiveness of mastery practice on skills accuracy and exam grade in introductory physics

    by Qiaoyi Liu, Harish Moni Prakash, Andrew F. Heckler

    We conducted two studies to investigate the extent to which brief, spaced, mastery practice on skills relevant to introductory physics affects student performance. The first study investigated the effect of practice of “specific” physics skills, each one relevant to only one or a few items on the course exam. This study employed a quasiexperimental design with 766 students assigned to “intervention” or “control” conditions by lecture section sharing common exams. Results of the first study indicate significant improvement in the performance for only some of the exam items relevant to the specific skills practiced. We also observed between-section performance differences on other exam items not relevant to training, which may be due to specific prior quiz items from individual instructors. The second study investigated the effect of practice on the “general” skill of algebra relevant to introductory physics, a skill which was relevant to most of the exam items. This study employed a similar quasiexperimental design with 363 students assigned to treatment or control conditions, and we also administered a reliable pre- and post-test assessment of the algebra skills that was iteratively developed for this project. Results from the second study indicate that 75% of students had high accuracy on the algebra pretest. Students in the control condition who scored low on the pretest gained about 0.7 standard deviations on the post-test, presumably from engagement with the course alone, and students in the algebra practice condition had statistically similar gains, indicating no observed effect of algebra practice on algebra pre- to post-test gains. In contrast, we find some potential evidence that the algebra practice improved final exam performance for students with high pretest scores and did not benefit students with low pretest scores, although this result is inconclusive: the point estimate of the effect size was 0.24 for high pretest scoring students, but the 95% confidence interval [ − 0.01 , 0.48] slightly overlapped with zero. Further, we find a statistically significant positive effect of algebra practice on exam items that have higher algebraic complexity and no effect for items with low complexity. One possible explanation for the added benefit of algebra practice for high-scoring students is fluency in algebra skills may have improved. Overall, our observations provide some evidence that spaced, mastery practice is beneficial for exam performance for specific and general skills, and that students who are better prepared in algebra may be especially benefitting from mastery practice in relevant algebra skills in terms of improved final exam performance.

  • Open Access

    The Recursive Cycle of Perceived Mindset and Psychological Distress in College

    by Kathryn Mary Kroeper, Laura K. Hildebrand, Tao Jiang, Ariana Hernandez-Colmenares, Katrina Brown, Abigail Wilk, Steven J. Spencer, Andrew Heckler, Kentaro Fujita

    College students are experiencing a significant mental health crisis, with rising rates of psychological distress. To help understand this trend, the present study examines recursive relationships in the classroom between perceived mindset beliefs—i.e., whether students perceive others in their classroom to view intelligence as malleable or fixed—and psychological distress. Across three time points, 288 undergraduates taking a physics course completed measures of perceived classroom mindset and psychological distress. Random intercept cross-lagged panel analyses, which controlled for demographic factors and students’ own mindset beliefs, revealed that perceiving the classroom culture as more fixed-minded early in the semester was associated with increased psychological distress later. Likewise, increased psychological distress early in the semester was associated with perceiving the classroom culture to be more fixed-minded later. These findings suggest that perceived mindset and distress are mutually reinforcing, highlighting the importance of addressing both in interventions aimed at alleviating student distress.

  • Open Access

    Evolution of response time and accuracy on online mastery practice assignments for introductory physics students

    by Megan Nieberding, Andrew F. Heckler

    We have investigated the temporal patterns of algebra (N=606) and calculus (N=507) introductory physics students practicing multiple basic physics topics several times throughout the semester using an online mastery homework application called science, technology, engineering, and mathematics (STEM) fluency aimed at improving basic physics skills. For all skill practice categories, we observed an increase in measures of student accuracy, such as a decrease in the number of questions attempted to reach mastery, and a decrease in response time per question, resulting in an overall decrease in the total time spent on the assignments. The findings in this study show that there are several factors that impact a student’s performance and evolution on the mastery assignments throughout the semester. For example, using linear mixed modeling, we report that students with lower math preparation for the physics class start with lower accuracy and slower response times on the mastery assignments than students with higher math preparation. However, by the end of the semester, the less prepared students reach similar performance levels to their more prepared classmates on the mastery assignments. This suggests that STEM fluency is a useful tool for instructors to implement to refresh student’s basic math skills. Additionally, gender and procrastination habits impact the effectiveness and progression of the student’s response time and accuracy on the STEM fluency assignments throughout the semester. We find that women initially answer more questions in the same amount of time as men before reaching mastery. As the semester progresses and students practice the categories more, this performance gap diminishes between males and females. In addition, we find that students who procrastinate (those who wait until the final few hours to complete the assignments) are spending more time on the assignments despite answering a similar number of questions as compared to students who do not procrastinate. We also find that student mindset (growth vs fixed mindset) was not related to a student’s progress on the online mastery assignments. Finally, we find that STEM fluency practice improves performance beyond the effects of other components of instruction, such as lectures, group-work recitations, and homework assignments.


  • Open Access

    Evolution of grades and social comparison concern within an introductory physics course

    by Srividya Suresh, Andrew F. Heckler

    This study investigates the evolution and associations between exam grades and social comparison concern (SCC) among students in an introductory calculus-based physics course. We begin with a descriptive characterization of midterm and final exam scores as well as pre-post SCC scores, including the concurrent evolution of these scores during the course. We hypothesize a feedback loop in which changes in SCC scores are mediated by exam grades, and changes in exam scores are mediated by SCC scores. We employ a structural equation model to determine whether the data are consistent with these hypotheses. Results indicate that there were significant within-student changes in the relative grade standing from exam to exam and that changes in SCC scores depended on both the pre-SCC scores and scores on the first midterm exam. Further, we find evidence that exam scores partially mediate the association between pre- and post-SCC scores, and in turn, post-SCC scores partially mediate associations between midterm and final exam scores, though the mediation effects are somewhat small, comprising 5%–10% of the total effects between exam scores and SCC. We also find that while SCC scores are somewhat correlated with exam scores, they are only very weakly correlated with nonexam grade components, consistent with the idea that exam scores (rather than nonexam scores) are driving changes in SCC and vice versa. Overall, the results provide empirical, correlational evidence to motivate further experimental investigation into a hypothesized dynamic and iterative feedback loop in which student concern about ability or performance compared to others (SCC) can either negatively or positively interfere with student performance on exams.


  • Open Access

    Patterns in assignment submission times: Procrastination, gender, grades, and grade components

    by Megan Nieberding, Andrew F. Heckler

    In this study we characterize student procrastination habits and investigate associations between these habits and student performance on graded course components, student beliefs about their own procrastination behavior, and gender. The procrastination habits of calculus-based introductory physics students are measured via the amount of time before the assignment deadline or “completion time” that students submit their work on relatively short (>30  min) weekly online assignments. With the aid of latent profile analysis, we find that one can meaningfully categorize students into 4 completion time classes that clearly distinguish students between their mean completion time, their week-to-week completion time patterns, assignment completion rates, mean course grades, and proportion of women. Consistent with many studies in a variety of contexts, we find that procrastinating students tend to have lower course grades. Closer examination of exam and nonexam grade components reveals that completion time is directly associated with the nonexam component, but its association with the exam component is weaker and completely mediated by the nonexam component grade. This is in contrast to student ACT score, which is strongly associated with exam component but only weakly associated with the nonexam component, and the direct association of ACT with the exam scores is only weakly mediated by nonexam scores. Further, we find that ACT score is at best very weakly correlated with completion time. Taken together this supports the idea that exam and nonexam components are separately predicted by the two somewhat “orthogonal” measures of ACT score and completion time, and we propose that these are measuring so-called cognitive and noncognitive factors, respectively. Regarding gender differences, we found that on average women tended to procrastinate less than men, submitting the assignments on average 8 h earlier than men. Considering previous studies documenting that women tend to score higher than men on nonexam components, we found that completion time completely mediates the gender differences in nonexam components, providing support for the hypothesis that procrastination mediates the gender differences in performance on nonexam components. Finally, we found that the overwhelming majority (90%) of students did not strategically (“actively”) intend to delay completion of the assignment, and that students who did indicate actively delaying were 2–3 times more likely to receive a D or E in the course.