Approach to scalability study of shared memory parallel systems

Anand Sivasubramaniam, Aman Singla, Umakishore Ramachandran, H. Venkateswaran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

The overheads in a parallel system that limit its scalability need to be identified and separated in order to enable parallel algorithm design and the development of parallel machines. Such overheads may be broadly classified into two components. The first one is intrinsic to the algorithm and arises due to factors such as the work-imbalance and the serial fraction. The second one is due to the interaction between the algorithm and the architecture and arises due to latency and contention in the network. A top-down approach to scalability study of shared memory parallel systems is proposed in this research. We define the notion of overhead functions associated with the different algorithmic and architectural characteristics to quantify the scalability of parallel systems; we isolate the algorithmic overhead and the overheads due to network latency and contention from the overall execution time of an application; we design and implement an execution-driven simulation platform that incorporates these methods for quantifying the overhead functions; and we use this simulator to study the scalability characteristics of five applications on shared memory platforms with different communication topologies.

Original languageEnglish (US)
Title of host publicationPerformance Evaluation Review
PublisherPubl by ACM
Pages171-180
Number of pages10
Edition1
ISBN (Print)089791659X, 9780897916592
DOIs
StatePublished - Jan 1 1994
EventProceedings of the 1994 ACM Sigmetrics on Measurement and Modeling of Computer Systems - Nashville, TN, USA
Duration: May 16 1994May 20 1994

Publication series

NamePerformance Evaluation Review
Number1
Volume22
ISSN (Print)0163-5999

Other

OtherProceedings of the 1994 ACM Sigmetrics on Measurement and Modeling of Computer Systems
CityNashville, TN, USA
Period5/16/945/20/94

Fingerprint

Scalability
Data storage equipment
Parallel algorithms
Simulators
Topology
Communication

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Sivasubramaniam, A., Singla, A., Ramachandran, U., & Venkateswaran, H. (1994). Approach to scalability study of shared memory parallel systems. In Performance Evaluation Review (1 ed., pp. 171-180). (Performance Evaluation Review; Vol. 22, No. 1). Publ by ACM. https://doi.org/10.1145/183019.183038
Sivasubramaniam, Anand ; Singla, Aman ; Ramachandran, Umakishore ; Venkateswaran, H. / Approach to scalability study of shared memory parallel systems. Performance Evaluation Review. 1. ed. Publ by ACM, 1994. pp. 171-180 (Performance Evaluation Review; 1).
@inproceedings{87198ede87a143e7b1d1500b8bdd8c6a,
title = "Approach to scalability study of shared memory parallel systems",
abstract = "The overheads in a parallel system that limit its scalability need to be identified and separated in order to enable parallel algorithm design and the development of parallel machines. Such overheads may be broadly classified into two components. The first one is intrinsic to the algorithm and arises due to factors such as the work-imbalance and the serial fraction. The second one is due to the interaction between the algorithm and the architecture and arises due to latency and contention in the network. A top-down approach to scalability study of shared memory parallel systems is proposed in this research. We define the notion of overhead functions associated with the different algorithmic and architectural characteristics to quantify the scalability of parallel systems; we isolate the algorithmic overhead and the overheads due to network latency and contention from the overall execution time of an application; we design and implement an execution-driven simulation platform that incorporates these methods for quantifying the overhead functions; and we use this simulator to study the scalability characteristics of five applications on shared memory platforms with different communication topologies.",
author = "Anand Sivasubramaniam and Aman Singla and Umakishore Ramachandran and H. Venkateswaran",
year = "1994",
month = "1",
day = "1",
doi = "10.1145/183019.183038",
language = "English (US)",
isbn = "089791659X",
series = "Performance Evaluation Review",
publisher = "Publ by ACM",
number = "1",
pages = "171--180",
booktitle = "Performance Evaluation Review",
edition = "1",

}

Sivasubramaniam, A, Singla, A, Ramachandran, U & Venkateswaran, H 1994, Approach to scalability study of shared memory parallel systems. in Performance Evaluation Review. 1 edn, Performance Evaluation Review, no. 1, vol. 22, Publ by ACM, pp. 171-180, Proceedings of the 1994 ACM Sigmetrics on Measurement and Modeling of Computer Systems, Nashville, TN, USA, 5/16/94. https://doi.org/10.1145/183019.183038

Approach to scalability study of shared memory parallel systems. / Sivasubramaniam, Anand; Singla, Aman; Ramachandran, Umakishore; Venkateswaran, H.

Performance Evaluation Review. 1. ed. Publ by ACM, 1994. p. 171-180 (Performance Evaluation Review; Vol. 22, No. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Approach to scalability study of shared memory parallel systems

AU - Sivasubramaniam, Anand

AU - Singla, Aman

AU - Ramachandran, Umakishore

AU - Venkateswaran, H.

PY - 1994/1/1

Y1 - 1994/1/1

N2 - The overheads in a parallel system that limit its scalability need to be identified and separated in order to enable parallel algorithm design and the development of parallel machines. Such overheads may be broadly classified into two components. The first one is intrinsic to the algorithm and arises due to factors such as the work-imbalance and the serial fraction. The second one is due to the interaction between the algorithm and the architecture and arises due to latency and contention in the network. A top-down approach to scalability study of shared memory parallel systems is proposed in this research. We define the notion of overhead functions associated with the different algorithmic and architectural characteristics to quantify the scalability of parallel systems; we isolate the algorithmic overhead and the overheads due to network latency and contention from the overall execution time of an application; we design and implement an execution-driven simulation platform that incorporates these methods for quantifying the overhead functions; and we use this simulator to study the scalability characteristics of five applications on shared memory platforms with different communication topologies.

AB - The overheads in a parallel system that limit its scalability need to be identified and separated in order to enable parallel algorithm design and the development of parallel machines. Such overheads may be broadly classified into two components. The first one is intrinsic to the algorithm and arises due to factors such as the work-imbalance and the serial fraction. The second one is due to the interaction between the algorithm and the architecture and arises due to latency and contention in the network. A top-down approach to scalability study of shared memory parallel systems is proposed in this research. We define the notion of overhead functions associated with the different algorithmic and architectural characteristics to quantify the scalability of parallel systems; we isolate the algorithmic overhead and the overheads due to network latency and contention from the overall execution time of an application; we design and implement an execution-driven simulation platform that incorporates these methods for quantifying the overhead functions; and we use this simulator to study the scalability characteristics of five applications on shared memory platforms with different communication topologies.

UR - http://www.scopus.com/inward/record.url?scp=0028428301&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028428301&partnerID=8YFLogxK

U2 - 10.1145/183019.183038

DO - 10.1145/183019.183038

M3 - Conference contribution

SN - 089791659X

SN - 9780897916592

T3 - Performance Evaluation Review

SP - 171

EP - 180

BT - Performance Evaluation Review

PB - Publ by ACM

ER -

Sivasubramaniam A, Singla A, Ramachandran U, Venkateswaran H. Approach to scalability study of shared memory parallel systems. In Performance Evaluation Review. 1 ed. Publ by ACM. 1994. p. 171-180. (Performance Evaluation Review; 1). https://doi.org/10.1145/183019.183038