Towards Actionable Pedagogical Feedback: A Multi-Perspective Analysis of Mathematics Teaching and Tutoring Dialogue
Preprint
Abstract
Effective feedback is essential for refining instructional practices in mathematics education, and researchers often turn to advanced natural language processing (NLP) models to analyze classroom dialogues from multiple perspectives. However, utterance-level discourse analysis encounters two primary challenges: (1) multifunctionality, where a single utterance may serve multiple purposes that a single tag cannot capture, and (2) the exclusion of many utterances from domain-specific discourse move classifications, leading to their omission in feedback. To address these challenges, we proposed a multi-perspective discourse analysis that integrates domain-specific talk moves with dialogue act (using the flattened multi-functional SWBD-MASL schema with 43 tags) and discourse relation (applying Segmented Discourse Representation Theory with 16 relations). Our top-down analysis framework enables a comprehensive understanding of utterances that contain talk moves, as well as utterances that do not contain talk moves. This is applied to two mathematics education datasets: TalkMoves (teaching) and SAGA22 (tutoring). Through distributional unigram analysis, sequential talk move analysis, and multi-view deep dive, we discovered meaningful discourse patterns, and revealed the vital role of utterances without talk moves, demonstrating that these utterances, far from being mere fillers, serve crucial functions in guiding, acknowledging, and structuring classroom discourse. These insights underscore the importance of incorporating discourse relations and dialogue acts into AI-assisted education systems to enhance feedback and create more responsive learning environments. Our framework may prove helpful for providing human educator feedback, but also aiding in the development of AI agents that can effectively emulate the roles of both educators and students.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Automated feedback improves teachers’ questioning quality in brick-and-mortar classrooms: Opportunities for further enhancementComputers & Education, 2024
- Developing dialogic classroom practices through supporting professional agency: Teachers’ experiences of using the T-SEDA practitioner-led inquiry approachTeaching and Teacher Education, 2023
- Effects of artificial Intelligence–Enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroomComputers & Education, 2022
- Learning design to support student-AI collaboration: perspectives of leading teachers for AI in educationEducation and Information Technologies, 2022
- How changes in teachers' dialogic discourse practice relate to changes in students' activation, motivation and cognitive engagementLearning, Culture and Social Interaction, 2021
- Effects of Online Content‐Focused Coaching on Discussion Quality and Reading Achievement: Building Theory for How Coaching Develops Teachers’ Adaptive ExpertiseReading Research Quarterly, 2020
- Teacher–Student Dialogue During Classroom Teaching: Does It Really Impact on Student Outcomes?Journal of the Learning Sciences, 2019
- Supporting teachers in taking up productive talk moves: The long road to professional learning at scaleInternational Journal of Educational Research, 2019
- Using Swivl Robotic Technology in Teacher Education Preparation: A Pilot StudyTechTrends, 2017
- The classification of cooperative illocutionary actsLanguage in Society, 1979