BurScale: Using Burstable Instances for Cost-Effective Autoscaling in the Public Cloud

Ataollah Fatahi Baarzi, Timothy Zhu, Bhuvan Urgaonkar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Cloud providers have recently introduced burstable instances-virtual machines whose CPU capacity is rate limited by token-bucket mechanisms. A user of a burstable instance is able to burst to a much higher resource capacity ("peak rate") than the instance's long-Term average capacity ("sustained rate"), provided the bursts are short and infrequent. A burstable instance tends to be much cheaper than a conventional instance that is always provisioned for the peak rate. Consequently, cloud providers advertise burstable instances as cost-effective options for customers with intermittent needs and small (e.g., single VM) clusters. By contrast, this paper presents two novel usage scenarios for burstable instances in larger clusters with sustained usage. We demonstrate (i) how burstable instances can be utilized alongside conventional instances to handle the transient queueing arising from variability in traffic, and (ii) how burstable instances can mask the VM startup/warmup time when autoscaling to handle flash crowds. We implement our ideas in a system called BurScale and use it to demonstrate cost-effective autoscaling for two important workloads: (i) a stateless web server cluster, and (ii) a stateful Memcached caching cluster. Results from our prototype system show that via its careful combination of burstable and regular instances, BurScale can ensure similar application performance as traditional autoscaling systems that use all regular instances while reducing cost by up to 50%.

Original languageEnglish (US)
Title of host publicationSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery
Pages126-138
Number of pages13
ISBN (Electronic)9781450369732
DOIs
StatePublished - Nov 20 2019
Event10th ACM Symposium on Cloud Computing, SoCC 2019 - Santa Cruz, United States
Duration: Nov 20 2019Nov 23 2019

Publication series

NameSoCC 2019 - Proceedings of the ACM Symposium on Cloud Computing

Conference

Conference10th ACM Symposium on Cloud Computing, SoCC 2019
Country/TerritoryUnited States
CitySanta Cruz
Period11/20/1911/23/19

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'BurScale: Using Burstable Instances for Cost-Effective Autoscaling in the Public Cloud'. Together they form a unique fingerprint.

Cite this