ABAllison Bradford

Allison Bradford

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Allison Bradford has a total of 10 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Combining Natural Language Processing with Epistemic Network Analysis to Investigate Student Knowledge Integration within an AI Dialog

    by Weiying Li, Hsin-Yi Chang, Allison Bradford, Libby Gerard, Marcia C. Linn

    In this study, we used Epistemic Network Analysis (ENA) to represent data generated by Natural Language Processing (NLP) analytics during an activity based on the Knowledge Integration (KI) framework. The activity features a web-based adaptive dialog about energy transfer in photosynthesis and cellular respiration. Students write an initial explanation, respond to two adaptive prompts in the dialog, and write a revised explanation. The NLP models score the KI level of the initial and revised explanations. They also detect the ideas in the explanations and the dialog responses. The dialog uses the detected ideas to prompt students to elaborate and refine their explanations. Participants were 196 8th-grade students at a public school in the Western United States. We used ENA to represent the idea networks at each KI score level for the revised explanations. We also used ENA to analyze the idea trajectories for the initial explanation, the two dialog responses, and the final explanation. Higher KI levels were associated with more links and increased frequency of mechanistic ideas in ENA representations. Representation of the trajectories suggests that the NLP adaptive dialog helped students who started with descriptive and macroscopic ideas to add more microscopic ideas. The dialog also helped students who started with partially linked ideas to keep linking the microscopic ideas to mechanistic ideas. We discuss implications for STEM teachers and researchers who are interested in how students build on their ideas to integrate their ideas.


  • Open Access

    Comparing Expert and ChatGPT-authored Guidance Prompts

    by Allison Bradford, Weiying Li, Libby Gerard, Marcia C. Linn

    Students bring a multitude of ideas and experiences to the classroom while they are reasoning about scientific phenomena. They often need timely guidance to refine build upon their initial ideas. In this study we explore the development of guidance prompts to provide students with personalized, real-time feedback in the context of a pedagogically grounded chatbot. In the current version of the tool, guidance prompts are authored by learning scientists who are experts in the content of the items and in Knowledge Integration pedagogy. When students engage with the chatbot, an idea detection model is used to determine the ideas that are present in a student explanation and then the expert-authored guidance prompts are assigned based on rules about which ideas are or are not present in the student explanation. While this approach allows for close attention to and control of the pedagogical intent of each prompt, it is time consuming and not easily generalizable. Further this rule-based approach limits the ways in which students can interact with the chatbot. The work in progress study presented in this paper explores the potential of using generative AI to create similarly pedagogically grounded guidance prompts as a first step towards increasing the generalizability and scalability of this approach. Specifically, we ask: using criteria from the Knowledge Integration Pedagogical Framework, how do ChatGPT 3.5-authored guidance prompts compare to human expert-authored guidance prompts? We find that while prompt engineering can enhance the alignment of ChatGPT-authored guidance prompts with pedagogical criteria, the human expert-authored guidance prompts more consistently meet the pedagogical criteria.


  • Open Access

    Teacher-informed Expansion of an Idea Detection Model for a Knowledge Integration Assessment

    by Weiying Li, Yuying Liao, Kenneth Steimel, Allison Bradford, Libby Gerard, Marcia Linn

    Students come to science classrooms with ideas informed by their prior instruction and everyday observations. Following constructivist pedagogy, assessments that encourage students to elaborate their ideas, distinguish among them, and link the most promising ones can capture students' potential and help teachers plan their lessons. In this investigation, we study an assessment that engages students in a dialog to refine their response to a Knowledge Integration (KI) question. Our Research Practice Partnership (RPP) initially trained a Natural Language Processing (NLP) idea detection model on 1218 student responses from 5 schools and identified 13 student ideas. The original model had an overall micro-averaged F-score of 0.7634. After classroom testing, three RPP expert teachers with 10+ years of experience reviewed the classroom data and expanded the model, adding six additional ideas including two that they described as precursor ideas because they foreshadowed more sophisticated reasoning. We trained the idea detection model on these 19 ideas using a dataset from 13 teachers and 1206 students across 8 public schools. The updated model had a somewhat lower overall micro-averaged F-score of 0.7297. The two precursor ideas were among the top four detected ideas. The assessment, using the updated model, guided students to express significantly more ideas. A regression model showed that the updated model was associated with greater KI score gains. Expanding the model, thus, created an assessment that motivated students to express more ideas and to achieve higher KI scores. It also provides teachers with deeper insights into their students' understanding of science.


  • Open Access

    Incorporating investigations of environmental racism into middle school science

    by Allison Bradford, Libby Gerard, Erika Tate, Rui Li, Marcia C. Linn

    To promote a justice‐oriented approach to science education, we formed a research‐practice partnership between middle school science teachers, their students, curriculum designers, learning scientists, and experts in social justice to co‐design and test an environmental justice unit for middle school instruction. We examine teacher perspectives on the challenges and possibilities of integrating social justice into their standards‐aligned science teaching as they participate in co‐design and teach the unit. The unit supports students to investigate racially disparate rates of asthma in their community by examining pollution maps and historical redlining maps. We analyze interviews and co‐design artifacts from two teachers who participated in the co‐design and taught the unit in their classrooms. Our findings point to the benefits of a shared pedagogical framework and an initial unit featuring local historical content to structure co‐design. Findings also reveal that teachers can share similar goals for empowering students to use science knowledge for civic action while framing the local socio‐political factors contributing to the injustice differently, due in part to different institutional supports and constraints. Student interviews and a pre/postassessment illustrate how the unit facilitated students' progress in connecting socio‐political and science ideas to explain the impacts of particulate matter pollution and who is impacted most. Analyses illuminate how teachers' pedagogical choices may influence whether and how students discuss the impact of systemic racism in their explanations. The findings inform refinement of the unit and suggest supports needed for co‐design partnerships focused on integrating social justice and science.