Effects of MSHR and Prefetch Mechanisms on an On-Chip Cache of the Vector Architecture
Authors:
- Akihoro MusaAMAkihoro Musa
- Yoshiei SatoYSYoshiei Sato
- Takashi SogaTSTakashi Soga
- Ryusuke EgawaRERyusuke Egawa
- Hiroyuki TakizawaHTHiroyuki Takizawa
- Koki OkabeKOKoki Okabe
- Hiroaki KobayashiHKHiroaki Kobayashi
- 1 December 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 335-342
Abstract
Vector supercomputers have been encountering the memory wall problem and their memory bandwidth per flop/s rate has decreased. To cover the insufficient memory bandwidth per flop/s rate, an on-chip vector cache has been proposed for the vector processors. Although vector caching is effective to increase the sustained performance to a certain degree, it still needs software and hardware supporting mechanisms to extract its potential. To this end, we propose miss status handling registers (MSHR) and a prefetch mechanism. This paper evaluates the performance of the vector cache with the MSHR and the prefetch mechanism on the vector supercomputer across three leading scientific applications. The MSHR is an effective mechanism for handling subsequent vector loads of the same data, which frequently appear in different schemes. The experimental results indicate that the MSHR can improve the computational performance of scientific applications by 1.45×. Moreover, we examine the performance of the prefetch mechanism on the vector cache. The prefetch mechanism increases the computational performance by 1.6×. Accordingly, the MSHR and the prefetching mechanism are very effective optimization options for vector caching of future vector supercomputers even if the vector supercomputers cannot maintain the current memory bandwidth per flop/s rate.Keywords
This publication has 14 references indexed in Scilit:
- The Potential of On-Chip Memory Systems for Future Vector Architectures2007
- An on-chip cache design for vector processors2007
- Implication of Memory Performance in Vector-Parallel and Scalar-Parallel HEC Systems2007
- Implications of Memory Performance for Highly Efficient Supercomputing of Scientific ApplicationsLecture Notes in Computer Science, 2006
- Performance Evaluation of the Cray X1 Distributed Shared-Memory ArchitectureIEEE Micro, 2005
- Performance characteristics of the Cray X1 and their implications for application performance tuning2004
- The Alpha 21264 microprocessorIEEE Micro, 1999
- When caches aren't enough: data prefetching techniquesComputer, 1997
- The effectiveness of caches for vector processors1994
- Data prefetching in multiprocessor vector cache memoriesACM SIGARCH Computer Architecture News, 1991