Memory-Side Prefetching Scheme Incorporating Dynamic Page Mode in 3D-Stacked DRAM
- 14 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 32 (11) , 2734-2747
Abstract
Modern multiprocessor systems running multiple applications concurrently exhibit irregular memory access pattern during different phases of execution. The principle of locality is hard to exploit in the presence of such irregular memory requests and may result in additional delays due to resource conflicts throughout memory hierarchy. Prefetching is a promising technique to reduce the memory access latency where data is speculatively fetched ahead of time and stored in a faster memory structure like cache or dedicated prefetch buffer. The emergence of 3D-stacked DRAM provides huge internal bandwidth that makes memory-side prefetching an effective approach to improving system performance. Leveraging the unique architecture of 3D-stacked DRAM, we introduce a memory-side prefetching scheme that works in conjunction with dynamic page mode to reduce memory access latency. We introduce a novel prefetch buffer management scheme that makes intelligent replacement decision based on the utilization and recency of the prefetched data, which also serves as a guidance for future prefetching. Simulation results indicate that our approach improves performance by 21.8 percent on average, compared to a baseline scheme that prefetches a whole row on consecutive hits and implements static open page policy. Our scheme also outperforms an existing memory-side prefetching scheme by 13.2 percent on average, which dynamically adjusts the prefetch degree based on the usefulness of prefetched data.Keywords
Funding Information
- National Science Foundation (CCF-1513899)
This publication has 46 references indexed in Scilit:
- FAPS-3D2019
- Perceptron-based prefetch filtering2019
- CAMPS2018
- HAPPY2016
- PIM-enabled instructions2015
- Data reorganization in memory using 3D-stacked DRAM2015
- Low-Power Hybrid Memory Cubes With Link Power Management and Two-Level PrefetchingIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2015
- Self-Optimizing Memory Controllers: A Reinforcement Learning Approach2008
- Optimizing NUCA Organizations and Wiring Alternatives for Large Caches with CACTI 6.02007
- Memory-side prefetching for linked data structures for processor-in-memory systemsJournal of Parallel and Distributed Computing, 2005