Providing tunable consistency for a parallel file store

Murali Vilayannur, Partho Nath, Anand Sivasubramaniam

Research output: Contribution to conferencePaperpeer-review

26 Scopus citations

Abstract

Consistency, throughput, and scalability form the backbone of a cluster-based parallel file system. With little or no information about the workloads to be supported, a file system designer has to often make a one-glove-fits-all decision regarding the consistency policies. Taking a hard stance on consistency demotes throughput and scalability to second-class status, having to make do with whatever leeway is available. Leaving the choice and granularity of consistency policies to the user at open/mount time provides an attractive way of providing the best of all worlds. We present the design and implementation of such a file-store, CAPFS (Content Addressable Parallel File System), that allows the user to define consistency semantic policies at runtime. A client-side plug-in architecture based on user-written plug-ins leaves the choice of consistency policies to the end-user. The parallelism exploited by use of multiple data stores provides for bandwidth and scalability. We provide extensive evaluations of our prototype file system on a concurrent read/write workload and a parallel tiled visualization code.

Original languageEnglish (US)
Pages17-30
Number of pages14
StatePublished - Jan 1 2005
Event4th USENIX Conference on File and Storage Technologies, FAST 2005 - San Francisco, United States
Duration: Dec 13 2005Dec 16 2005

Conference

Conference4th USENIX Conference on File and Storage Technologies, FAST 2005
CountryUnited States
CitySan Francisco
Period12/13/0512/16/05

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Software
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Providing tunable consistency for a parallel file store'. Together they form a unique fingerprint.

Cite this