Minimizing data and synchronization costs in one-way communication

Mahmut Kandemir, Alok Choudhary, Prithviraj Banerjee, J. Ramanujam, Nagaraj Shenoy

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Minimizing communication and synchronization costs is crucial to the realization of the performance potential of parallel computers. This paper presents a general technique which uses a global data-flow framework to optimize communication and synchronization in the context of the one-way communication model. In contrast to the conventional send/receive message-passing communication model, one-way communication is a new paradigm that decouples message transmission and synchronization. In parallel machines with appropriate low-level support, this may open up new opportunities not only to further optimize communication, but also to reduce the synchronization overhead. We present optimization techniques using our framework for eliminating redundant data communication and synchronization operations. Our approach works with the most general data alignments and distributions in languages like High Performance Fortran (HPF) and uses a combination of the traditional data-flow analysis and polyhedral algebra. Empirical results for several scientific benchmarks on a Cray T3E multiprocessor machine demonstrate that our approach is successful in reducing the number of data (communication) and synchronization messages, thereby reducing the overall execution times.

Original languageEnglish (US)
Pages (from-to)1232-1251
Number of pages20
JournalIEEE Transactions on Parallel and Distributed Systems
Volume11
Issue number12
DOIs
StatePublished - Dec 1 2000

Fingerprint

Synchronization
Communication
Costs
Data flow analysis
Message passing
Algebra

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Cite this

Kandemir, Mahmut ; Choudhary, Alok ; Banerjee, Prithviraj ; Ramanujam, J. ; Shenoy, Nagaraj. / Minimizing data and synchronization costs in one-way communication. In: IEEE Transactions on Parallel and Distributed Systems. 2000 ; Vol. 11, No. 12. pp. 1232-1251.
@article{a222f7cd57b8482883ea4f78a1ba6d6e,
title = "Minimizing data and synchronization costs in one-way communication",
abstract = "Minimizing communication and synchronization costs is crucial to the realization of the performance potential of parallel computers. This paper presents a general technique which uses a global data-flow framework to optimize communication and synchronization in the context of the one-way communication model. In contrast to the conventional send/receive message-passing communication model, one-way communication is a new paradigm that decouples message transmission and synchronization. In parallel machines with appropriate low-level support, this may open up new opportunities not only to further optimize communication, but also to reduce the synchronization overhead. We present optimization techniques using our framework for eliminating redundant data communication and synchronization operations. Our approach works with the most general data alignments and distributions in languages like High Performance Fortran (HPF) and uses a combination of the traditional data-flow analysis and polyhedral algebra. Empirical results for several scientific benchmarks on a Cray T3E multiprocessor machine demonstrate that our approach is successful in reducing the number of data (communication) and synchronization messages, thereby reducing the overall execution times.",
author = "Mahmut Kandemir and Alok Choudhary and Prithviraj Banerjee and J. Ramanujam and Nagaraj Shenoy",
year = "2000",
month = "12",
day = "1",
doi = "10.1109/71.895791",
language = "English (US)",
volume = "11",
pages = "1232--1251",
journal = "IEEE Transactions on Parallel and Distributed Systems",
issn = "1045-9219",
publisher = "IEEE Computer Society",
number = "12",

}

Minimizing data and synchronization costs in one-way communication. / Kandemir, Mahmut; Choudhary, Alok; Banerjee, Prithviraj; Ramanujam, J.; Shenoy, Nagaraj.

In: IEEE Transactions on Parallel and Distributed Systems, Vol. 11, No. 12, 01.12.2000, p. 1232-1251.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Minimizing data and synchronization costs in one-way communication

AU - Kandemir, Mahmut

AU - Choudhary, Alok

AU - Banerjee, Prithviraj

AU - Ramanujam, J.

AU - Shenoy, Nagaraj

PY - 2000/12/1

Y1 - 2000/12/1

N2 - Minimizing communication and synchronization costs is crucial to the realization of the performance potential of parallel computers. This paper presents a general technique which uses a global data-flow framework to optimize communication and synchronization in the context of the one-way communication model. In contrast to the conventional send/receive message-passing communication model, one-way communication is a new paradigm that decouples message transmission and synchronization. In parallel machines with appropriate low-level support, this may open up new opportunities not only to further optimize communication, but also to reduce the synchronization overhead. We present optimization techniques using our framework for eliminating redundant data communication and synchronization operations. Our approach works with the most general data alignments and distributions in languages like High Performance Fortran (HPF) and uses a combination of the traditional data-flow analysis and polyhedral algebra. Empirical results for several scientific benchmarks on a Cray T3E multiprocessor machine demonstrate that our approach is successful in reducing the number of data (communication) and synchronization messages, thereby reducing the overall execution times.

AB - Minimizing communication and synchronization costs is crucial to the realization of the performance potential of parallel computers. This paper presents a general technique which uses a global data-flow framework to optimize communication and synchronization in the context of the one-way communication model. In contrast to the conventional send/receive message-passing communication model, one-way communication is a new paradigm that decouples message transmission and synchronization. In parallel machines with appropriate low-level support, this may open up new opportunities not only to further optimize communication, but also to reduce the synchronization overhead. We present optimization techniques using our framework for eliminating redundant data communication and synchronization operations. Our approach works with the most general data alignments and distributions in languages like High Performance Fortran (HPF) and uses a combination of the traditional data-flow analysis and polyhedral algebra. Empirical results for several scientific benchmarks on a Cray T3E multiprocessor machine demonstrate that our approach is successful in reducing the number of data (communication) and synchronization messages, thereby reducing the overall execution times.

UR - http://www.scopus.com/inward/record.url?scp=0034482961&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034482961&partnerID=8YFLogxK

U2 - 10.1109/71.895791

DO - 10.1109/71.895791

M3 - Article

AN - SCOPUS:0034482961

VL - 11

SP - 1232

EP - 1251

JO - IEEE Transactions on Parallel and Distributed Systems

JF - IEEE Transactions on Parallel and Distributed Systems

SN - 1045-9219

IS - 12

ER -