Boa
Authors:
Open Access
- 2 December 2015
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 25 (1) , 1-34
Abstract
In today's software-centric world, ultra-large-scale software repositories, such as SourceForge, GitHub, and Google Code, are the new library of Alexandria. They contain an enormous corpus of software and related information. Scientists and engineers alike are interested in analyzing this wealth of information. However, systematic extraction and analysis of relevant data from these repositories for testing hypotheses is hard, and best left for mining software repository (MSR) experts! Specifically, mining source code yields significant insights into software development artifacts and processes. Unfortunately, mining source code at a large scale remains a difficult task. Previous approaches had to either limit the scope of the projects studied, limit the scope of the mining task to be more coarse grained, or sacrifice studying the history of the code. In this article we address mining source code: (a) at a very large scale; (b) at a fine-grained level of detail; and (c) with full history information. To address these challenges, we present domain-specific language features for source-code mining in our language and infrastructure called Boa . The goal of Boa is to ease testing MSR-related hypotheses. Our evaluation demonstrates that Boa substantially reduces programming efforts, thus lowering the barrier to entry. We also show drastic improvements in scalability.Keywords
Funding Information
- US National Science Foundation (CNS-15-13263, CNS-15-12947, CCF-14-23370, CCF-13-49153, CCF-13-20578, TWC-12-23828, CCF-11-17937, CCF-10-17334 and CCF-10-18600)
This publication has 36 references indexed in Scilit:
- An exploratory study of the design impact of language features for aspect-oriented interfaces2012
- On the reproducibility of empirical software engineering studies based on data retrieved from development repositoriesEmpirical Software Engineering, 2011
- The Eval That Men Do2011
- Sourcerer: mining and searching internet-scale software repositoriesData Mining and Knowledge Discovery, 2008
- BigtableACM Transactions on Computer Systems, 2008
- Interpreting the Data: Parallel Analysis with SawzallScientific Programming, 2005
- Some Simple Economics of Open SourceThe Journal of Industrial Economics, 2002
- DJ: Dynamic Adaptive Programming in Java2001
- The cathedral and the bazaarKnowledge and Policy, 1999
- Space/time trade-offs in hash coding with allowable errorsCommunications of the ACM, 1970