Towards Understanding Fine-Grained Programming Mistakes and Fixing Patterns in Data Science
Open Access
- 19 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 2 (FSE) , 1824-1846
Abstract
Programming is an essential activity in data science (DS). Unlike regular software developers, DS programmers often use Jupyter notebooks instead of conventional IDEs. Moreover, DS programmers focus on statistics, data analytics, and modeling rather than writing production-ready code following best practices in software engineering. Thus, in order to provide effective tool support to improve their productivity, it is important to understand what kinds of errors they make and how they fix them. Previous studies have analyzed DS code from public code-sharing platforms such as GitHub and Kaggle. However, they only accounted for code changes committed to the version history, omitting many programming mistakes that are resolved before code commits. To bridge the gap, we present an in-depth analysis of the fine-grained logs of a DS competition, which includes 390 Jupyter Notebooks written by participants over six weeks. In addition, we conducted semi-structured interviews with 10 DS programmers from different domains to understand the reasons behind their programming mistakes. We identified several unique programming mistakes and fix patterns that had not been reported before, highlighting opportunities for designing new tool support for DS programming.Keywords
This publication has 64 references indexed in Scilit:
- What constitutes debugging? An exploratory study of debugging episodesEmpirical Software Engineering, 2023
- Automated Program Repair in the Era of Large Pre-trained Language Models2023
- Workflow analysis of data science code in public GitHub repositoriesEmpirical Software Engineering, 2022
- Impact of Software Engineering Research in Practice: A Patent and Author Survey AnalysisIEEE Transactions on Software Engineering, 2022
- Mining Python fix patterns via analyzing fine-grained source code changesEmpirical Software Engineering, 2022
- KnowledgePearls: Provenance-Based Visualization RetrievalIEEE Transactions on Visualization and Computer Graphics, 2018
- Exploring exploratory programming2017
- The ManyBugs and IntroClass Benchmarks for Automated Repair of C ProgramsIEEE Transactions on Software Engineering, 2015
- An Empirical Analysis of Bug Reports and Bug Fixing in Open Source Android Apps2013
- An Empirical Study of Bugs in Machine Learning Systems2012