A New Visualization Framework for Multimodal Programming Attention in Debugging Test
Open Access
- 5 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 35-41
Abstract
The programmer’s attention have been utilized for the behavioral research in programming education. Existing approaches mainly focused on the programmer’s visual attention measured by gaze trackers. However, for the scenarios of programming and debugging, the measurement on just eye movements is not sufficient for understanding programming attention. The measurements on programmer’s other modals of behaviors, including mouse clicks and keyboard inputs, are also required. In this paper, we focus on the programming attention visualization problem in the debugging test scenario. A series of attention visualization approaches are proposed for the two main types of interactions, i.e. reading source code and editing/debugging by keyboard and mouse. We develop methods to visualize student’s attentions from either reading or debugging interactions, and then merge them into multimodal programming attention. The experiment results show that, the proposed multimodal attention graphs can show the diversity of students’ debugging strategies in terms of reading and editing focus in code line and time dimensions. It can help the teacher infer the students’ behavioral intentions and conduct individual diagnose in debugging tests.Keywords
Funding Information
- National Education Scientific Planning Project of China (23LH0102)
- National Nature Science Foundation of China (61977064)
This publication has 18 references indexed in Scilit:
- A Study of Debugging Sequence on Multi-Bug Program2021
- Task-oriented Analysis on Debugging Process Based on Eye Movements and IDE Interactions2021
- Visually analyzing eye movements on natural language texts and source code snippets2019
- iTrace: enabling eye tracking on software artifacts within the IDE to support software engineering tasks2015
- Eye Movements in Code Reading: Relaxing the Linear Order2015
- Circular heat map transition diagram2013
- Visual Analysis of Eye Tracking Data2013
- Individual user characteristics and information visualization2013
- An eye-tracking study on the role of scan time in finding source code defects2012
- Grand Challenges in Computing: Education--A SummaryThe Computer Journal, 2005