FACADE
Authors:
Open Access
- 14 March 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 675-690
Abstract
The past decade has witnessed the increasing demands on data-driven business intelligence that led to the proliferation of data-intensive applications. A managed object-oriented programming language such as Java is often the developer's choice for implementing such applications, due to its quick development cycle and rich community resource. While the use of such languages makes programming easier, their automated memory management comes at a cost. When the managed runtime meets Big Data, this cost is significantly magnified and becomes a scalability-prohibiting bottleneck. This paper presents a novel compiler framework, called Facade, that can generate highly-efficient data manipulation code by automatically transforming the data path of an existing Big Data application. The key treatment is that in the generated code, the number of runtime heap objects created for data types in each thread is (almost) statically bounded, leading to significantly reduced memory management cost and improved scalability. We have implemented Facade and used it to transform 7 common applications on 3 real-world, already well-optimized Big Data frameworks: GraphChi, Hyracks, and GPS. Our experimental results are very positive: the generated programs have (1) achieved a 3%--48% execution time reduction and an up to 88X GC reduction; (2) consumed up to 50% less memory, and (3) scaled to much larger datasets.Keywords
Funding Information
- National Science Foundation (CNS-1321179, CCF-140982)
- Office of Naval Research (N00014-14-1-0549)
This publication has 78 references indexed in Scilit:
- DryadACM SIGOPS Operating Systems Review, 2007
- PADS/MLACM SIGPLAN Notices, 2007
- The next 700 data description languagesACM SIGPLAN Notices, 2006
- Automatic pool allocationACM SIGPLAN Notices, 2005
- Run‐time evaluation of opportunities for object inlining in JavaConcurrency and Computation: Practice and Experience, 2005
- A region-based memory manager for prologACM SIGPLAN Notices, 2000
- An automatic object inlining optimization and its evaluationACM SIGPLAN Notices, 2000
- Memory management with explicit regionsACM SIGPLAN Notices, 1998
- Better static memory managementACM SIGPLAN Notices, 1995
- Query evaluation techniques for large databasesACM Computing Surveys, 1993