Many-core compiler fuzzing
Authors:
Open Access
- 3 June 2015
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGPLAN Notices
- Vol. 50 (6) , 65-76
Abstract
We address the compiler correctness problem for many-core systems through novel applications of fuzz testing to OpenCL compilers. Focusing on two methods from prior work, random differential testing and testing via equivalence modulo inputs (EMI), we present several strategies for random generation of deterministic, communicating OpenCL kernels, and an injection mechanism that allows EMI testing to be applied to kernels that otherwise exhibit little or no dynamically-dead code. We use these methods to conduct a large, controlled testing campaign with respect to 21 OpenCL (device, compiler) configurations, covering a range of CPU, GPU, accelerator, FPGA and emulator implementations. Our study provides independent validation of claims in prior work related to the effectiveness of random differential testing and EMI testing, proposes novel methods for lifting these techniques to the many-core setting and reveals a significant number of OpenCL compiler bugs in commercial implementations.Keywords
This publication has 12 references indexed in Scilit:
- Oclgrind2015
- Compiler validation via equivalence modulo inputs2014
- A sound and complete abstraction for reasoning about parallel prefix sumsACM SIGPLAN Notices, 2014
- Engineering a Static Verification Tool for GPU Kernels2014
- Taming compiler fuzzers2013
- Compiler testing via a theory of sound optimisations in the C11/C++11 memory model2013
- Test-case reduction for C compiler bugs2012
- Finding and understanding bugs in C compilers2011
- Volatiles are miscompiled, and what to do about it2008
- Fault-based testing without the need of oraclesInformation and Software Technology, 2003