Compiler-directed file layout optimization for hierarchical storage systems

Wei Ding, Yuanrui Zhang, Mahmut Kandemir, Seung Woo Son

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.

Original languageEnglish (US)
Title of host publication2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012
DOIs
StatePublished - Dec 1 2012
Event2012 24th International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012 - Salt Lake City, UT, United States
Duration: Nov 10 2012Nov 16 2012

Publication series

NameInternational Conference for High Performance Computing, Networking, Storage and Analysis, SC
ISSN (Print)2167-4329
ISSN (Electronic)2167-4337

Other

Other2012 24th International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012
CountryUnited States
CitySalt Lake City, UT
Period11/10/1211/16/12

Fingerprint

Application programs

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Software

Cite this

Ding, W., Zhang, Y., Kandemir, M., & Son, S. W. (2012). Compiler-directed file layout optimization for hierarchical storage systems. In 2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012 [6468469] (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). https://doi.org/10.1109/SC.2012.35
Ding, Wei ; Zhang, Yuanrui ; Kandemir, Mahmut ; Son, Seung Woo. / Compiler-directed file layout optimization for hierarchical storage systems. 2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012. 2012. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).
@inproceedings{588e12d48eda47f1b1dbbefd01f7b915,
title = "Compiler-directed file layout optimization for hierarchical storage systems",
abstract = "File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7{\%} on average.",
author = "Wei Ding and Yuanrui Zhang and Mahmut Kandemir and Son, {Seung Woo}",
year = "2012",
month = "12",
day = "1",
doi = "10.1109/SC.2012.35",
language = "English (US)",
isbn = "9781467308069",
series = "International Conference for High Performance Computing, Networking, Storage and Analysis, SC",
booktitle = "2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012",

}

Ding, W, Zhang, Y, Kandemir, M & Son, SW 2012, Compiler-directed file layout optimization for hierarchical storage systems. in 2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012., 6468469, International Conference for High Performance Computing, Networking, Storage and Analysis, SC, 2012 24th International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012, Salt Lake City, UT, United States, 11/10/12. https://doi.org/10.1109/SC.2012.35

Compiler-directed file layout optimization for hierarchical storage systems. / Ding, Wei; Zhang, Yuanrui; Kandemir, Mahmut; Son, Seung Woo.

2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012. 2012. 6468469 (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Compiler-directed file layout optimization for hierarchical storage systems

AU - Ding, Wei

AU - Zhang, Yuanrui

AU - Kandemir, Mahmut

AU - Son, Seung Woo

PY - 2012/12/1

Y1 - 2012/12/1

N2 - File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.

AB - File layout of array data is a critical factor that effects the behavior of storage caches, and has so far taken not much attention in the context of hierarchical storage systems. The main contribution of this paper is a compiler-driven file layout optimization scheme for hierarchical storage caches. This approach, fully automated within an optimizing compiler, analyzes a multi-threaded application code and determines a file layout for each disk-resident array referenced by the code, such that the performance of the target storage cache hierarchy is maximized. We tested our approach using 16 I/O intensive application programs and compared its performance against two previously proposed approaches under different cache space management schemes. Our experimental results show that the proposed approach improves the execution time of these parallel applications by 23.7% on average.

UR - http://www.scopus.com/inward/record.url?scp=84877693975&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877693975&partnerID=8YFLogxK

U2 - 10.1109/SC.2012.35

DO - 10.1109/SC.2012.35

M3 - Conference contribution

AN - SCOPUS:84877693975

SN - 9781467308069

T3 - International Conference for High Performance Computing, Networking, Storage and Analysis, SC

BT - 2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012

ER -

Ding W, Zhang Y, Kandemir M, Son SW. Compiler-directed file layout optimization for hierarchical storage systems. In 2012 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2012. 2012. 6468469. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). https://doi.org/10.1109/SC.2012.35