Narrowing the Gap between Serverless and its State with Storage Functions

Tian Zhang, Dong Xie, Feifei Li, Ryan Stutsman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

Serverless computing has gained attention due to its fine-grained provisioning, large-scale multi-Tenancy, and on-demand scaling. However, it also forces applications to externalize state in remote storage, adding substantial overheads. To fix this "data shipping problem"we built Shredder, a low-latency multi-Tenant cloud store that allows small units of computation to be performed directly within storage nodes. Storage tenants provide Shredder with JavaScript functions (or WebAssembly programs), which can interact directly with data without moving them over the network. The key challenge in Shredder is safely isolating thousands of tenant storage functions while minimizing data interaction costs. Shredder uses a unique approach where its data store and networking paths are implemented in native code to ensure performance, while isolated tenant functions interact with data using a V8-specific intermediate representation that avoids expensive cross-protection-domain calls and data copying. As a result, Shredder can execute 4 million remotely-invoked tenant functions per second spread over thousands of tenants with median and 99th-percentile response latencies of less than 50 µs and 500 µs, respectively. Our evaluation shows that Shredder achieves a 14% to 78% speedup against conventional remote storage when fetching items with just one to three data dependencies between them. We also demonstrate Shredder's effectiveness in accelerating data-intensive applications, including a k-hop query on social graphs that shows orders of magnitude gain.

Original languageEnglish (US)
Title of host publicationSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery
Pages1-12
Number of pages12
ISBN (Electronic)9781450369732
DOIs
StatePublished - Nov 20 2019
Event10th ACM Symposium on Cloud Computing, SoCC 2019 - Santa Cruz, United States
Duration: Nov 20 2019Nov 23 2019

Publication series

NameSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing

Conference

Conference10th ACM Symposium on Cloud Computing, SoCC 2019
CountryUnited States
CitySanta Cruz
Period11/20/1911/23/19

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'Narrowing the Gap between Serverless and its State with Storage Functions'. Together they form a unique fingerprint.

Cite this