Aestimo: a feedback-directed optimization evaluation tool
Authors:
- P. BerubePBP. Berube
- J.N. AmaralJAJ.N. Amaral
- 28 April 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 251-260
Abstract
Published studies that use feedback-directed optimiza- tion (FDO) techniques use either a single input for both training and performance evaluation, or a single input for training and a single input for evaluation. Thus an impor- tant question is if the FDO results published in the literature are sensitive to the training and testing input selection. Aestimo is a new evaluation tool that uses a workload of inputs to evaluate the sensitivity of specific code transfor- mations to the choice of inputs in the training and testing phases. Aestimo uses optimization logs to isolate the effects of individual code transformations. It incorporates metrics to determine the effect of training input selection on indi- vidual compiler decisions. Besides describing the structure of Aestimo, this paper presents a case study that uses SPEC CINT2000 benchmark programs with the Open Research Compiler (ORC) to in- vestigate the effect of training/testing input selection on in- lining and if-conversion. The experimental results indicate that: (1) training input selection affects the compiler de- cisions made for these code transformation; (2) the choice of training/testing inputs can have a significant impact on measured performance.Keywords
This publication has 9 references indexed in Scilit:
- Measuring Program Similarity: Experiments with SPEC CPU Benchmark Suites2005
- Inducing heuristics to decide whether to schedule2004
- Fast searches for effective optimization phase sequences2004
- Meta optimization2003
- Designing computer architecture research workloadsComputer, 2003
- MisSPECulation2003
- Combined selection of tile sizes and unroll factors using iterative compilation2002
- MinneSPEC: A New SPEC Benchmark Workload for Simulation-Based Computer Architecture ResearchIEEE Computer Architecture Letters, 2002
- Using profile information to assist classic code optimizationsSoftware: Practice and Experience, 1991