Unified compiler algorithm for optimizing locality, parallelism and communication in out-of-core computations

M. Kandemir, A. Choudhary, J. Ramanujam, M. Kandaswamy

Research output: Contribution to conferencePaperpeer-review

6 Scopus citations

Abstract

This paper presents compiler algorithms to optimize out-of-core programs. These algorithms consider loop and data layout transformations in a unified framework. The performance of an out-of-core loop nest containing many references can be improved by a combination of restructuring the loops and file layouts. This approach considers array references one-by-one and attempts to optimize each reference for parallelism and locality. When there are references for which parallelism optimizations do not work, communication is vectorized so that data transfer can be performed before the innermost tiling loop. Preliminary results from hand-compiles on IBM SP-2 and Intel Paragon show that this approach reduces the execution time, improves the bandwidth speedup and overall speedup. In addition, we extend the base algorithm to work with file layout constraints and show how it can be used for optimizing programs consisting of multiple loop nests.

Original languageEnglish (US)
Pages79-92
Number of pages14
StatePublished - 1997
EventProceedings of the 1997 5th Workshop on I/O in Parallel and Distributed Systems - San Jose, CA, USA
Duration: Nov 17 1997Nov 17 1997

Other

OtherProceedings of the 1997 5th Workshop on I/O in Parallel and Distributed Systems
CitySan Jose, CA, USA
Period11/17/9711/17/97

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Unified compiler algorithm for optimizing locality, parallelism and communication in out-of-core computations'. Together they form a unique fingerprint.

Cite this