Compiler algorithms for optimizing locality and parallelism on shared and distributed memory machines

M. Kandemir, J. Ramanujam, A. Choudhary

Research output: Contribution to journalConference article

7 Scopus citations

Abstract

Distributed memory message passing machines can deliver scalable performance but are difficult to program. Shared memory machines, on the other hand, are easier to program but obtaining scalable performance with large number of processors is difficult. Recently, some scalable architectures based on logically-shared physically-distributed memory have been designed and implemented. While some of the performance issues like parallelism and locality are common to the different parallel architectures, issues such as data decomposition are unique to specific types of architectures. One of the most important challenges compiler writers face is to design compilation techniques that can work on a variety of architectures. In this paper, we propose an algorithm that can be employed by optimizing compilers for different types of parallel architectures. Our optimization algorithm does the following: (1) transforms loop nests such that, where possible, the outermost loops can be run in parallel across processors; (2) decomposes each array across processors; (3) optimizes interprocessor communication by vectorizing it whenever possible; and (4) optimizes locality (cache performance) by assigning appropriate storage layout for each array. Depending on the underlying hardware system, some or all of these steps can be applied in a unified framework. We present simulation results for cache miss rates, and empirical results on SUN SPARCstation 5, IBM SP-2, SGI Challenge and Convex Exemplar to validate the effectiveness of our approach on different architectures.

Original languageEnglish (US)
Pages (from-to)236-245
Number of pages10
JournalParallel Architectures and Compilation Techniques - Conference Proceedings, PACT
StatePublished - Dec 1 1997
EventProceedings of the 1997 International Conference on Parallel Architectures and Compilation Techniques - San Francisco, CA, USA
Duration: Nov 10 1997Nov 14 1997

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture

Cite this