An approach to scalability study of shared memory parallel systems
Authors:
Open Access
- 1 May 1994
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 22 (1) , 171-180
Abstract
The overheads in a parallel system that limit its scalability need to be identified and separated in order to enable parallel algorithm design and the development of parallel machines. Such overheads may be broadly classified into two components. The first one is intrinsic to the algorithm and arises due to factors such as the work-imbalance and the serial fraction. The second one is due to the interaction between the algorithm and the architecture and arises due to latency and contention in the network. A top-down approach to scalability study of shared memory parallel systems is proposed in this research. We define the notion of overhead functions associated with the different algorithmic and architectural characteristics to quantify the scalability of parallel systems; we isolate the algorithmic overhead and the overheads due to network latency and contention from the overall execution time of an application; we design and implement an execution-driven simulation platform that incorporates these methods for quantifying the overhead functions; and we use this simulator to study the scalability characteristics of five applications on shared memory platforms with different communication topologies.Keywords
This publication has 17 references indexed in Scilit:
- Architectural requirements of parallel scientific applications with explicit communication1993
- LogP: towards a realistic model of parallel computation1993
- The Nas Parallel BenchmarksThe International Journal of Supercomputing Applications, 1991
- Limits on interconnection network performanceIEEE Transactions on Parallel and Distributed Systems, 1991
- The performance of spin lock alternatives for shared-memory multiprocessorsIEEE Transactions on Parallel and Distributed Systems, 1990
- The impact of synchronization and granularity on parallel systems1990
- The effect of sharing on the cache and bus performance of parallel programs1989
- Development of Parallel Methods for a $1024$-Processor HypercubeSIAM Journal on Scientific and Statistical Computing, 1988
- The rice parallel processing testbed1988
- Validity of the single processor approach to achieving large scale computing capabilities1967