Kernel-level caching for optimizing I/O by exploiting inter-application data sharing

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

With applications becoming larger and the increasing load on high performance systems, it is important to tackle the I/O bottleneck problem from several angles. It is not only essential to optimize the I/O accesses of any one application, but also to be able to identify and exploit opportunities resulting front the sharing of datasets across applications. Clusters are rapidly becoming the platform of choice for demanding applications due to their cost-effectiveness and widespread deployment. Consequently, this paper attempts to optimize data sharing across applications concurrently executing on the cluster. Specifically, we propose and implement a kernel-level caching module at each node of a Linux cluster that can be used to service several processes of different applications. Using detailed evaluations on an actual Linux cluster this paper demonstrates the benefits of this module in optimizing intra and inter-application I/O requests.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Cluster Computing, CLUSTER 2002
EditorsBill Gropp, Rajkumar Buyya, Rob Pennington, Maxine Brown, Mark Baker, Dan Reed
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages425-432
Number of pages8
ISBN (Electronic)0769517455
DOIs
Publication statusPublished - Jan 1 2002
EventIEEE International Conference on Cluster Computing, CLUSTER 2002 - Chicago, United States
Duration: Sep 23 2002Sep 26 2002

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
Volume2002-January
ISSN (Print)1552-5244

Other

OtherIEEE International Conference on Cluster Computing, CLUSTER 2002
CountryUnited States
CityChicago
Period9/23/029/26/02

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Signal Processing

Cite this

Vilayannur, M., Kandemir, M., & Sivasubramaniam, A. (2002). Kernel-level caching for optimizing I/O by exploiting inter-application data sharing. In B. Gropp, R. Buyya, R. Pennington, M. Brown, M. Baker, & D. Reed (Eds.), Proceedings - IEEE International Conference on Cluster Computing, CLUSTER 2002 (pp. 425-432). [1137775] (Proceedings - IEEE International Conference on Cluster Computing, ICCC; Vol. 2002-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CLUSTR.2002.1137775