Virtual I/O caching: Dynamic storage cache management for concurrent workloads

Michael Frasca, Ramya Prabhakar, Padma Raghavan, Mahmut Kandemir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations

Abstract

A leading cause of reduced or unpredictable application performance in distributed systems is contention at the storage layer, where resources are multiplexed among many concurrent data intensive workloads. We target the shared storage cache, used to alleviate disk I/O bottlenecks, and propose a new caching paradigm to both improve performance and reduce memory requirements for HPC storage systems. We present the virtual I/O cache, a dynamic scheme to manage a limited storage cache resource. Application behavior and the corresponding performance of a chosen replacement policy are observed at run time, and a mechanism is designed to mitigate suboptimal behavior and increase cache efficiency. We further use the virtual I/O cache to isolate concurrent workloads and globally manage physical resource allocation towards system level performance objectives. We evaluate our scheme using twenty I/O intensive applications and benchmarks. Average hit rate gains over 17% were observed for isolated workloads, as well as cache size reductions near 80% for equivalent performance levels. Our largest concurrent workload achieved hit rate gains over 23%, and an over 80% iso-performance cache reduction.

Original languageEnglish (US)
Title of host publicationProceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis
DOIs
StatePublished - 2011
Event2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC11 - Seattle, WA, United States
Duration: Nov 12 2011Nov 18 2011

Publication series

NameProceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Other

Other2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC11
CountryUnited States
CitySeattle, WA
Period11/12/1111/18/11

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Virtual I/O caching: Dynamic storage cache management for concurrent workloads'. Together they form a unique fingerprint.

  • Cite this

    Frasca, M., Prabhakar, R., Raghavan, P., & Kandemir, M. (2011). Virtual I/O caching: Dynamic storage cache management for concurrent workloads. In Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis [38] (Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis). https://doi.org/10.1145/2063384.2063435