PerfDBT: Efficient Performance Regression Testing of Dynamic Binary Translation
- 1 October 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 389-392
Abstract
Dynamic binary translation (DBT) has been adopted in many important applications. Due to the large scale and complexity of a DBT system, a minor code change may lead to unexpected impact on the performance. Therefore, it is necessary to conduct performance regression testing for DBT systems. However, existing benchmark suites are not suitable for daily performance testing due to the extremely-long testing time. To address this challenge, we propose PerffiBT, which employs a novel approach to automatically generate test programs from existing long-running benchmarks. The execution times of the generated test programs are much shorter, which allows them to be used for daily performance regression testing of a DBT system. Experimental results demonstrate that the test programs generated by PerfDBT can achieve an average of 71X testing efficiency compared to original benchmarks. Furthermore, it can also deliver similar testing results to original benchmarks.Keywords
This publication has 11 references indexed in Scilit:
- Model Learning and Model-Based Testing2018
- Improving Dynamically-Generated Code Performance on Dynamic Binary Translators2018
- Enhancing Cross-ISA DBT Through Automatically Learned Translation Rules2018
- Automated Performance Deviation Detection across Software Versions Releases2017
- Enabling Cross-ISA Offloading for COTS Binaries2017
- Effective Regression Test Case SelectionACM Computing Surveys, 2017
- Continuous validation of load test suites2014
- A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation2012
- How to use SimPoint to pick simulation pointsACM SIGMETRICS Performance Evaluation Review, 2004
- Analyzing regression test selection techniquesIEEE Transactions on Software Engineering, 1996