KMKelly Miller

Kelly Miller

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Kelly Miller has a total of 17 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Teaching problem solving in undergraduate physics courses: An endorsement for deliberate practice

    by Kelly Miller, Olivia Miller, Georgia Lawrence

    Developing expertlike problem-solving skills is a central goal of undergraduate physics education. In this study, we investigate the impact of teaching explicit problem-solving frameworks, combined with deliberate practice, on students’ problem-solving approaches. Using multidimensional scaling to analyze students’ decision-making patterns, we compare the similarity of students taught with these methods to physics experts and to students taught with traditional repeated practice. Our results show that students who received structured frameworks and targeted feedback through deliberate practice exhibited problem-solving behaviors significantly more aligned with those of experts. These findings suggest that pedagogies emphasizing explicit strategy instruction and feedback are more effective than rote repetition for fostering expertise. We recommend the integration of these approaches into physics curricula to better support the development of skilled and adaptive problem solvers.

  • Open Access

    Response-shift bias in student self-efficacy during an actively taught physics course

    by Kelly Miller, Tobias Espinosa, Ives Araujo, Isaura Gallegos

    Self-efficacy is an important measure in science education as it is predictive of persistence and success in science, technology, engineering, and mathematics (STEM) courses and is an influential factor in students’ decisions to major in STEM fields. It is unclear what effect active teaching strategies have on students’ self-efficacy, which is typically measured with a pretest at the beginning of the semester and a post-test at the end of the semester. To better understand what happens to self-efficacy over the course of an actively taught physics class, in addition to the typical pretest and post-test, we used a reflective pretest. At the end of the semester, we asked students to reflect on their abilities at the beginning of the semester and we compared this “reflective” self-efficacy to both their presemester and postsemester self-efficacy. We found that students’ reflective self-efficacy was systematically lower than their self-efficacy at the beginning of the semester. Interviews reveal that discrepancies between presemester self-efficacy and reflective self-efficacy are the result of response-shift bias. Because of students’ limited experience with active learning environments, response-shift bias makes it difficult to accurately measure students’ change in self-efficacy over the semester of an actively taught physics course. We conclude that reflective pretests in combination with interviews can help educators and researchers understand if changes in self-efficacy are being masked by response-shift bias.


  • Open Access

    How gender composition and group formation impact the effectiveness of group work in two-stage collaborative exams

    by Kelly Miller, Greg Kestin, Olivia Miller

    Two-stage collaborative exams are an increasingly popular form of formative assessment which have shown promising results in promoting student learning. While the benefit of two-stage collaborative exams is well researched, there is no clear consensus on the best way of implementing them—specifically with respect to forming student groups. In some studies students self-select their groups, and in others they are assigned by the instructor (either randomly or with a specific grouping algorithm). Research has shown that performance and satisfaction in group learning situations improves when faculty, not students, select the groups. Furthermore, studies have demonstrated that students’ learning benefits from working in groups with diverse learning styles, abilities, gender, and race. In this study, we report on a controlled experiment conducted during a two-stage collaborative exam in an introductory physics course at Harvard University. For the group stage of the exam, half of the groups were formed by the instructor (based on balancing gender and performance on previous exams) and the other half were student selected. We compared performance on both the individual and group stage of the exam for the instructor-formed versus student-formed groups. We also surveyed students on their experiences during the group exam. We found that female students perform better on two-part collaborative exams when they are in student-formed groups. We also found that in the student-formed groups students (especially female students) felt more comfortable speaking up and felt that their groups were both “more effective and productive” and “more receptive to their ideas” than in the instructor-formed groups. This study provides important insights into best practice implementation of two-stage collaborative exams.


  • Open Access

    Harnessing active engagement in educational videos: Enhanced visuals and embedded questions

    by Greg Kestin, Kelly Miller

    The prevalence of online instruction highlights the importance of videos in education. Pedagogies that include elements that actively engage students are accepted as an improvement over more passive modes of instruction. How can we transfer the advantages of active engagement to instruction via video? Previous research on instructional videos has shown that there are a number of principles, the adherence to which benefit student learning by maximizing productive cognitive processing. To understand the impact of combining such principles we designed and produced four different versions of the same physics demonstration video, varying levels of “visual enhancement” designed around these principles and the amount of active engagement across the different versions. Using pre-post video testing, we compared how much viewers learned across the four different versions. We found that actively engaging students by embedding questions throughout the video increases student learning. We also found that physics videos are most effective when they include enhanced visuals and embedded questions. Notably, it is the combination that matters most; the learning effect from embedding questions is increased when the video also includes enhanced visuals. This study represents an important step towards understanding how instructors can design and refine their videos to maximize student learning.


  • Open Access

    Increasing the effectiveness of active learning using deliberate practice: A homework transformation

    by Kelly Miller, Kristina Callaghan, Logan S. McCarty, Louis Deslauriers

    We show how learning can be improved, beyond that shown in actively taught classrooms, by also transforming the homework using the principles of deliberate practice. We measure the impact of transforming the homework on student learning in a course that had already implemented an active approach to teaching in class. We compare performance on the same final exam in equivalent cohorts of students over three semesters of an introductory physics course: the first taught with traditional lectures and traditional homework, the second taught with active instruction coupled with traditional homework, and the last taught with both active instruction and transformed homework. We find students in the semester where both active teaching and transformed homework are used scored significantly higher on the final exam than the students taught actively but with traditional homework. This learning gain achieved by transforming the homework is comparable to that achieved by replacing traditional lectures with active teaching strategies in class. We further show the positive effects of transforming the homework on student learning through a shorter, controlled experiment. When everything but the homework implementation is controlled, students scored 5%–10% higher on a test of learning following transformed homework compared with traditional homework. This significant improvement to learning occurs despite students spending a similar amount of time on task. This study represents an initial step towards understanding how deliberate practice can be extended to improve pedagogy beyond what happens in the classroom to the out-of-class homework.


  • Open Access

    The Influence of Student Enrollment in Pre-College Engineering Courses on Their Interest in Engineering Careers

    by Kelly A Miller, Gerhard Sonnert, Philip M Sadler

    Pre-college student enrollment in engineering courses increases every year in the United States, yet little is known about the relationship between taking these courses and subsequent science, technology, engineering, and mathematics (STEM) career interest. Through multinomial logistic regressions, and while controlling for student background variables and prior STEM career interest, this study addresses two research questions: (1) Does completing a pre-college engineering course increase the likelihood of an engineering career interest at the end of high school? (2) Does completing a pre-college engineering course have a different influence on career interest in engineering than on career interest in other STEM fields (namely science, technology, and mathematics)? The study uses data from the Outreach Programs and Science Career Intentions survey (N 5 15,847), a large U.S. sample of college students enrolled in mandatory English courses. Our analysis reveals that the relationship between completing a pre-college engineering course and interest in a STEM career appears to be field-specific. Students completing a pre-college engineering course were two times more likely to want to pursue an engineering career than those without such a course, after controlling for a host of other relevant variables. By contrast, taking a pre-college engineering course was not associated with heightened interest in other science, technology, or mathematics careers. These findings suggest that high schools should offer engineering courses as an effective way to foster students’ career interest in engineering. This effect appears to apply similarly to all students, independent of gender, race/ethnicity, and other background variables.


  • Open Access

    Use of a Social Annotation Platform for Pre-Class Reading Assignments in a Flipped Introductory Physics Class

    by Kelly Miller, Brian Lukoff, Gary King, Eric Mazur

    In this paper, we illustrate the successful implementation of pre-class reading assignments through a social learning platform that allows students to discuss the reading online with their classmates. We show how the platform can be used to understand how students are reading before class. We find that, with this platform, students spend an above average amount of time reading (compared to that reported in the literature) and that most students complete their reading assignments before class. We identify specific reading behaviors that are predictive of in-class exam performance. We also demonstrate ways that the platform promotes active reading strategies and produces high-quality learning interactions between students outside class. Finally, we compare the exam performance of two cohorts of students, where the only difference between them is the use of the platform; we show that students do significantly better on exams when using the platform.


  • The influence of students’ participation in STEM competitions on their interest in STEM careers

    by Kelly Miller, Gerhard Sonnert, Philip Sadler

    Pre-college student participation in science fairs, robotics competitions, computing contests and other science, technology, engineering, and mathematics (STEM) competitions increases every year in the United States. This is despite the fact that little is known about the relationship between STEM competition participation and career interest in STEM. Through logistic regressions, this study addresses three main research questions: Controlling for student background variables and prior STEM career interest, does participating in a STEM competition increase the likelihood of STEM career interest at the end of high school? Does the field of competition (robotics, engineering, science fair, information technology) a student participates in influence the sub-discipline of STEM career interest? And, what is the relationship between the number of competitions participated in and the probability of interest in a STEM career? The study uses data from the ‘Outreach Programs and Science Career Intentions’ survey (N = 15,847), a large-scale sample of university students enrolled in mandatory English courses. Our data reveal three results of interest. First, students who participate in STEM competitions are more likely to express interest in a STEM-related career at the end of high school than are students who do not participate, even when students’ prior career interest in STEM is controlled for. Second, the relationship between competition participation and interest in a STEM career appears to be domain specific. Third, the impact of competition participation on pursuit of a STEM career is three times stronger when students compete in more than one competition. These findings suggest that competitions are an effective way to foster career interest in specific STEM careers.


  • Open Access

    Conceptual question response times in Peer Instruction classrooms

    by Kelly Miller, Nathaniel Lasry, Brian Lukoff, Julie Schell, Eric Mazur

    Classroom response systems are widely used in interactive teaching environments as a way to engage students by asking them questions. Previous research on the time taken by students to respond to conceptual questions has yielded insights on how students think and change conceptions. We measure the amount of time students take to respond to in-class, conceptual questions [ConcepTests (CTs)] in two introductory physics courses taught using Peer Instruction and use item response theory to determine the difficulty of the CTs. We examine response time differences between correct and incorrect answers both before and after the peer discussion for CTs of varying difficulty. We also determine the relationship between response time and student performance on a standardized test of incoming physics knowledge, precourse self-efficacy, and gender. Our data reveal three results of interest. First, response time for correct answers is significantly faster than for incorrect answers, both before and after peer discussion, especially for easy CTs. Second, students with greater incoming physics knowledge and higher self-efficacy respond faster in both rounds. Third, there is no gender difference in response rate after controlling for incoming physics knowledge scores, although males register significantly more attempts before committing to a final answer than do female students. These results provide insight into effective CT pacing during Peer Instruction. In particular, in order to maintain a pace that keeps everyone engaged, students should not be given too much time to respond. When around 80% of the answers are in, the ratio of correct to incorrect responses rapidly approaches levels indicating random guessing and instructors should close the poll.