RFVP
Authors:
Open Access
- 6 January 2016
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 12 (4) , 1-26
Abstract
This article aims to tackle two fundamental memory bottlenecks: limited off-chip bandwidth (bandwidth wall) and long access latency (memory wall). To achieve this goal, our approach exploits the inherent error resilience of a wide range of applications. We introduce an approximation technique, called Rollback-Free Value Prediction (RFVP). When certain safe-to-approximate load operations miss in the cache, RFVP predicts the requested values. However, RFVP does not check for or recover from load-value mispredictions, hence, avoiding the high cost of pipeline flushes and re-executions. RFVP mitigates the memory wall by enabling the execution to continue without stalling for long-latency memory accesses. To mitigate the bandwidth wall, RFVP drops a fraction of load requests that miss in the cache after predicting their values. Dropping requests reduces memory bandwidth contention by removing them from the system. The drop rate is a knob to control the trade-off between performance/energy efficiency and output quality. Our extensive evaluations show that RFVP, when used in GPUs, yields significant performance improvement and energy reduction for a wide range of quality-loss levels. We also evaluate RFVP’s latency benefits for a single core CPU. The results show performance improvement and energy reduction for a wide variety of applications with less than 1% loss in quality.Keywords
This publication has 59 references indexed in Scilit:
- Scaling Performance via Self-Tuning Approximation for Graphics EnginesACM Transactions on Computer Systems, 2014
- General-purpose code acceleration with limited-precision analog computationACM SIGARCH Computer Architecture News, 2014
- Dynamic Detection of Uniform and Affine Vectors in GPGPU Computations2010
- CAVAACM Transactions on Architecture and Code Optimization, 2006
- Fuzzy Memoization for Floating-Point Multimedia ApplicationsIEEE Transactions on Computers, 2005
- Enhancing Memory-Level Parallelism via Recovery-Free Value PredictionIEEE Transactions on Computers, 2005
- How to use SimPoint to pick simulation pointsACM SIGMETRICS Performance Evaluation Review, 2004
- Runahead execution: an effective alternative to large instruction windowsIEEE Micro, 2003
- Using Dataflow Based Context for Accurate Branch Prediction2002
- Value locality and load value predictionACM SIGPLAN Notices, 1996