Python API Misuse Mining and Classification Based on Hybrid Analysis and Attention Mechanism
- 7 August 2023
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- Vol. 33 (10) , 1567-1597
Abstract
APIs play a crucial role in contemporary software development, streamlining implementation and maintenance processes. However, improper API usage can result in significant issues such as unexpected outcomes, security vulnerabilities and system crashes. To detect API misuses, current methods primarily rely on comparing established API usage patterns with target points for automated detection, mainly based on pre-validated datasets. Nonetheless, there is a scarcity of publicly available datasets on API misuses and their corresponding fixes, which hinders data-driven research. Moreover, most existing techniques concentrate on statically typed languages, such as Java and C, with only a few addressing dynamic languages like Python effectively, due to difficulties in handling dynamic features. Therefore, it is essential to identify Python API misuses and their fixes automatically and promptly. In this paper, we introduce HatPAM, a Hybrid Analysis and Attention-based Python API-Misuse Miner, which (a) provides a method for automatically mining true-positive commits related to Python API-misuse fixes from GitHub and (b) presents the subsequent processing for classifying Python API misuses in true-positive cases. Particularly, HatPAM applies hybrid static analysis and introduces a structure-based attention mechanism to examine syntax, semantics and structural features in Python code context, and considers the consistency between code and developers’ natural intent to significantly reduce false-positive cases. Evaluation on six popular Python projects reveals that HatPAM outperforms various state-of-the-art baselines, achieving up to 92.2% Precision, 86.7% Recall and 89.3% F1-score, indicating its capability to identify and classify Python API-misuse commits.Keywords
Funding Information
- NSFC (62272214)
- Cooperation Fund of Huawei-Nanjing University Next Generation Programming Innovation Lab (YBN2019105178SW32)
- Nanjing University-Huawei Joint Laboratory of New Software Technology (TC20230202021-2023-X)
This publication has 31 references indexed in Scilit:
- Bugs.jar2018
- A Systematic Evaluation of Static API-Misuse DetectorsIEEE Transactions on Software Engineering, 2018
- Automated identification of security issues from commit messages and bug reports2017
- The ManyBugs and IntroClass Benchmarks for Automated Repair of C ProgramsIEEE Transactions on Software Engineering, 2015
- Detecting missing method calls as violations of the majority ruleACM Transactions on Software Engineering and Methodology, 2013
- A large-scale empirical study of just-in-time quality assuranceIEEE Transactions on Software Engineering, 2012
- What should developers be aware of? An empirical study on the directives of API documentationEmpirical Software Engineering, 2011
- Mining temporal specifications from object usageAutomated Software Engineering, 2011
- Alattin: Mining Alternative Patterns for Detecting Neglected Conditions2009
- Classifying Software Changes: Clean or Buggy?IEEE Transactions on Software Engineering, 2008