ApproxHPVM: a portable compiler IR for accuracy-aware optimizations
Authors:
Open Access
- 10 October 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Programming Languages
- Vol. 3 (OOPSLA) , 1-30
Abstract
We propose ApproxHPVM, a compiler IR and system designed to enable accuracy-aware performance and energy tuning on heterogeneous systems with multiple compute units and approximation methods. ApproxHPVM automatically translates end-to-end application-level quality metrics into accuracy requirements for individual operations. ApproxHPVM uses a hardware-agnostic accuracy-tuning phase to do this translation that provides greater portability across heterogeneous hardware platforms and enables future capabilities like accuracy-aware dynamic scheduling and design space exploration. ApproxHPVM incorporates three main components: (a) a compiler IR with hardware-agnostic approximation metrics, (b) a hardware-agnostic accuracy-tuning phase to identify error-tolerant computations, and (c) an accuracy-aware hardware scheduler that maps error-tolerant computations to approximate hardware components. As ApproxHPVM does not incorporate any hardware-specific knowledge as part of the IR, it can serve as a portable virtual ISA that can be shipped to all kinds of hardware platforms. We evaluate our framework on nine benchmarks from the deep learning domain and five image processing benchmarks. Our results show that our framework can offload chunks of approximable computations to special-purpose accelerators that provide significant gains in performance and energy, while staying within user-specified application-level quality metrics with high probability. Across the 14 benchmarks, we observe from 1-9x performance speedups and 1.1-11.3x energy reduction for very small reductions in accuracy.Keywords
Funding Information
- DARPA (HR0011-18-C-0122)
This publication has 38 references indexed in Scilit:
- ShiDianNao2015
- Stash2015
- Autotuning algorithmic choice for input sensitivity2015
- Chisel2014
- Stochastic optimization of floating-point programs with tunable precision2014
- Paraprox2014
- Verifying quantitative reliability for programs that execute on unreliable hardware2013
- Parallelizing Sequential Programs with Statistical Accuracy TestsACM Transactions on Embedded Computing Systems, 2013
- Managing performance vs. accuracy trade-offs with loop perforation2011
- Probabilistic accuracy bounds for fault-tolerant computations that discard tasks2006