Restructuring I/O-intensive computations for locality

M. Kandemir, A. Choudhary, J. Ramanujam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes restructuring techniques for out-of-core programs (i.e., those that deal with very large quantities of data) based on exploiting locality using a combination of loop and data transformations. Writing efficient out-of-core program is an arduous task. As a result, compiler optimizations directed at improving YO performance are becoming increasingly important. We describe how a compiler can improve the performance of the code by determining appropriate file layouts for out-of-core arrays and finding suitable loop transformations. In addition to optimizing a single loop nest, our solution can handle a sequence of loop nests. We also show how to generate code when the file layouts are optimized. Preliminary experimental results obtained on an Intel Paragon distributed-memory message-passing multiprocessor demonstrate marked improvements in performance due to the optimizations described in this paper

Original languageEnglish (US)
Title of host publicationHigh-Performance Computing and Networking - 7th International Conference, HPCN Europe 1999, Proceedings
EditorsPeter Sloot, Alfons Hoekstra, Bob Hertzberger, Marian Bubak
PublisherSpringer Verlag
Pages1097-1106
Number of pages10
ISBN (Print)3540658211, 9783540658214
DOIs
StatePublished - 1999
Event7th International Conference on High-Performance Computing and Networking, HPCN Europe 1999 - Amsterdam, Netherlands
Duration: Apr 12 1999Apr 14 1999

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1593
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other7th International Conference on High-Performance Computing and Networking, HPCN Europe 1999
CountryNetherlands
CityAmsterdam
Period4/12/994/14/99

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Restructuring I/O-intensive computations for locality'. Together they form a unique fingerprint.

  • Cite this

    Kandemir, M., Choudhary, A., & Ramanujam, J. (1999). Restructuring I/O-intensive computations for locality. In P. Sloot, A. Hoekstra, B. Hertzberger, & M. Bubak (Eds.), High-Performance Computing and Networking - 7th International Conference, HPCN Europe 1999, Proceedings (pp. 1097-1106). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1593). Springer Verlag. https://doi.org/10.1007/bfb0100670