Samantha Boatright Smith
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Samantha Boatright Smith has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Narges Norouzi
University of California, Berkeley, Berkeley, CA, USA
6 shared publications - John DeNero
University of California, Berkeley, Berkeley, CA, USA
5 shared publications - Abigail O'NEill
University of California, Berkeley, Berkeley, CA, USA
4 shared publications - J. D. Zamfirescu-Pereira
Computer Science, University of California, Los Angeles, Los Angeles, California, USA
4 shared publications - Rose Niousha
University of California, Berkeley
3 shared publications - Aneesh Durai
University of California, Berkeley, Berkeley, CA, USA
2 shared publications
Latest Publications
- 25 June 2026
- Published by Springer Nature
- p. 384-398
The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness
- 25 June 2026
- Published by Springer Nature
- p. 384-398
The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness
- Open Access
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1455-1456
Misconception-Aware LLM Programming Tutor: Lessons Learned from Student-Tutor Interactions
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1455-1456
Open AccessMisconception-Aware LLM Programming Tutor: Lessons Learned from Student-Tutor Interactions
- Open Access
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1533-1534
Knowledge Component-Driven Alignment of CS1 Textbooks and Exercises
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1533-1534
Open AccessKnowledge Component-Driven Alignment of CS1 Textbooks and Exercises
- Open Access
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1453-1454
Instructors' Perspectives on LLM-Generated Programming Formative Feedback
- 17 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1453-1454
Open AccessInstructors' Perspectives on LLM-Generated Programming Formative Feedback
- Open Access
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1565-1566
From Code to Concepts: Textbook-Driven Knowledge Tracing with LLMs in CS1
Gauging a student's understanding of course concepts, at an arbitrary point during a course, can be challenging. Standardized exams offer only a snapshot of performance rather than a deep understanding of progress. However, with Large Language Models (LLMs) now deployed at scale in CS1 courses, we can track multiple attempts from each student for every homework problem. This data provides insights into how students learn and deploy concepts over time, presenting a unique opportunity to rethink how we track changes in individual student knowledge. Traditional Knowledge Tracing (KT) methods often lack explainability and are computationally expensive. In contrast, our framework leverages an LLM to identify student progress on labeled, problem-level concepts from a student homework code submission. Our initial results show that the student's knowledge state can be dynamically updated. This knowledge state can then be used to provide more targeted, effective feedback and create tailored study materials.
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1565-1566
Open AccessFrom Code to Concepts: Textbook-Driven Knowledge Tracing with LLMs in CS1
Gauging a student's understanding of course concepts, at an arbitrary point during a course, can be challenging. Standardized exams offer only a snapshot of performance rather than a deep understanding of progress. However, with Large Language Models (LLMs) now deployed at scale in CS1 courses, we can track multiple attempts from each student for every homework problem. This data provides insights into how students learn and deploy concepts over time, presenting a unique opportunity to rethink how we track changes in individual student knowledge. Traditional Knowledge Tracing (KT) methods often lack explainability and are computationally expensive. In contrast, our framework leverages an LLM to identify student progress on labeled, problem-level concepts from a student homework code submission. Our initial results show that the student's knowledge state can be dynamically updated. This knowledge state can then be used to provide more targeted, effective feedback and create tailored study materials.
- Open Access
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1627-1628
Spotting AI Missteps: Students Take on LLM Errors in CS1
CS1 courses have rapidly adopted Large Language Model (LLM)- based assistance, promising quick and always-available support for homework help. However, it is challenging to ensure that the hints and guidance provided by these models are accurate and not based on hallucinated solutions. In this work, we study and categorize LLM behavior in cases where students believe an LLM-powered homework tutor gave an inaccurate hint. We then describe correlations between certain student behaviors (SB) and our suggested bot-behavior (BB) categories.
- 18 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1627-1628
Open AccessSpotting AI Missteps: Students Take on LLM Errors in CS1
CS1 courses have rapidly adopted Large Language Model (LLM)- based assistance, promising quick and always-available support for homework help. However, it is challenging to ensure that the hints and guidance provided by these models are accurate and not based on hallucinated solutions. In this work, we study and categorize LLM behavior in cases where students believe an LLM-powered homework tutor gave an inaccurate hint. We then describe correlations between certain student behaviors (SB) and our suggested bot-behavior (BB) categories.