Exploiting spot and burstable instances for improving the cost-efficacy of in-memory caches on the public cloud

Cheng Wang, Bhuvan Urgaonkar, Aayush Gupta, George Kesidis, Qianlin Liang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

In order to keep the costs of operating in-memory storage on the public cloud low, we devise novel ideas and enabling modeling and optimization techniques for combining conventional Amazon EC2 instances with the cheaper spot and burstable instances. Whereas a naturally appealing way of using failure-prone spot instances is to selectively store unpopular ("cold") content, we show that a form of "hot-cold mixing" across regular and spot instances might be more cost-effective. To overcome performance degradation resulting from spot instance revocations, we employ a highly available passive backup using the recently emergent burstable instances. We show how the idiosyncratic resource allocations of burstable instances make them ideal candidates for such a backup. We implement all our ideas in an EC2-based memcached prototype. Using simulations and live experiments on our prototype, we show that (i) our hot-cold mixing, informed by our modeling of spot prices, helps improve cost savings by 50-80% compared to only using regular instances, and (ii) our burstable-based backup helps reduce performance degradation during spot revocation, e.g., the 95% latency during failure recovery improves by 25% compared to a backup based on regular instances.

Original languageEnglish (US)
Title of host publicationProceedings of the 12th European Conference on Computer Systems, EuroSys 2017
PublisherAssociation for Computing Machinery, Inc
Pages620-634
Number of pages15
ISBN (Electronic)9781450349383
DOIs
StatePublished - Apr 23 2017
Event12th European Conference on Computer Systems, EuroSys 2017 - Belgrade, Serbia
Duration: Apr 23 2017Apr 26 2017

Publication series

NameProceedings of the 12th European Conference on Computer Systems, EuroSys 2017

Other

Other12th European Conference on Computer Systems, EuroSys 2017
CountrySerbia
CityBelgrade
Period4/23/174/26/17

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Software
  • Information Systems
  • Hardware and Architecture
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Exploiting spot and burstable instances for improving the cost-efficacy of in-memory caches on the public cloud'. Together they form a unique fingerprint.

  • Cite this

    Wang, C., Urgaonkar, B., Gupta, A., Kesidis, G., & Liang, Q. (2017). Exploiting spot and burstable instances for improving the cost-efficacy of in-memory caches on the public cloud. In Proceedings of the 12th European Conference on Computer Systems, EuroSys 2017 (pp. 620-634). (Proceedings of the 12th European Conference on Computer Systems, EuroSys 2017). Association for Computing Machinery, Inc. https://doi.org/10.1145/3064176.3064220