Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 384-395
Abstract
An eye-tracking study of 18 developers reading and summarizing Java methods is presented. The developers provide a written summary for methods assigned to them. In total, 63 methods are used from five different systems. Previous studies on this topic use only short methods presented in isolation usually as images. In contrast, this work presents the study in the Eclipse IDE allowing access to all the source code in the system. The developer can navigate via scrolling and switching files while writing the summary. New eye-tracking infrastructure allows for this improvement in the study environment. Data collected includes eye gazes on source code, written summaries, and time to complete each summary. Unlike prior work that concluded developers focus on the signature the most, these results indicate that they tend to focus on the method body more than the signature. Moreover, both experts and novices tend to revisit control flow terms rather than reading them for a long period. They also spend a significant amount of gaze time and have higher gaze visits when they read call terms. Experts tend to revisit the body of the method significantly more frequently than its signature as the size of the method increases. Moreover, experts tend to write their summaries from source code lines that they read the most.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- A systematic literature review on the usage of eye-tracking in software engineeringInformation and Software Technology, 2015
- Tracing software developers' eyes and interactions for change tasks2015
- iTrace: enabling eye tracking on software artifacts within the IDE to support software engineering tasks2015
- An Eye-Tracking Study of Java Programmers and Application to Source Code SummarizationIEEE Transactions on Software Engineering, 2015
- An empirical study of the textual similarity between source code and source code summariesEmpirical Software Engineering, 2014
- Improving automated source code summarization via an eye-tracking study of programmers2014
- An eye-tracking study on the role of scan time in finding source code defects2012
- Towards automatically generating summary comments for Java methods2010
- Temporal eye-tracking data2008
- A study of the documentation essential to software maintenance2005