SOFTScale: Stealing opportunistically for transient scaling

Anshul Gandhi, Timothy Zhu, Mor Harchol-Balter, Michael A. Kozuch

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Dynamic capacity provisioning is a well studied approach to handling gradual changes in data center load. However, abrupt spikes in load are still problematic in that the work in the system rises very quickly during the setup time needed to turn on additional capacity. Performance can be severely affected even if it takes only 5 seconds to bring additional capacity online. In this paper, we propose SOFTScale, an approach to handling load spikes in multi-tier data centers without having to over-provision resources. SOFTScale works by opportunistically stealing resources from other tiers to alleviate the bottleneck tier, even when the tiers are carefully provisioned at capacity. SOFTScale is especially useful during the transient overload periods when additional capacity is being brought online. Via implementation on a 28-server multi-tier testbed, we investigate a range of possible load spikes, including an artificial doubling or tripling of load, as well as large spikes in real traces. We find that SOFTScale can meet our stringent 95th percentile response time Service Level Agreement goal of 500ms without using any additional resources even under some extreme load spikes that would normally cause the system (without SOFTScale) to exhibit response times as high as 96 seconds.

Original languageEnglish (US)
Title of host publicationMiddleware 2012 - ACM/IFIP/USENIX 13th International Middleware Conference, Proceedings
Pages142-163
Number of pages22
StatePublished - Nov 28 2012
Event13th ACM/IFIP/USENIX International Middleware Conference, Middleware 2012 - Montreal, QC, Canada
Duration: Dec 3 2012Dec 7 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7662 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other13th ACM/IFIP/USENIX International Middleware Conference, Middleware 2012
CountryCanada
CityMontreal, QC
Period12/3/1212/7/12

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'SOFTScale: Stealing opportunistically for transient scaling'. Together they form a unique fingerprint.

  • Cite this

    Gandhi, A., Zhu, T., Harchol-Balter, M., & Kozuch, M. A. (2012). SOFTScale: Stealing opportunistically for transient scaling. In Middleware 2012 - ACM/IFIP/USENIX 13th International Middleware Conference, Proceedings (pp. 142-163). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7662 LNCS).