Fine-grained resource scaling in a public cloud: A Tenant's perspective

Cheng Wang, Aayush Gupta, Bhuvan Urgaonkar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Growing tenant workload needs and an increasingly competitive market will force cloud providers to operate their data centers at significantly higher utilization levels than seen today. We argue that a key enabler of such cloud ecosystems would be facilities for tenants to engage in fine-grained resource scaling in addition to those offered by current providers. The basic unit of resource scaling exposed by current cloud providers is the canonical interface of virtual machines (VMs) with relatively static resource capacities. This paper describes opportunities and challenges in augmenting this interface to also include finegrained scaling of CPU and memory within an already procured VM. Qualitative arguments for why this would offer cost benefits for both the provider and its tenants are presented. We focus on the cost-effective operation of a tenant in such an environment via the design of a feedback controller. The efficacy of our ideas is illustrated by implementing a case study in a Memcached tenant workload. Our results are promising and point to an interesting and broad area for further research-e.g., with the real-world workload in our evaluation, up to 50% utility improvement can be achieved by just applying memory scaling; a further 66% improvement can be achieved by coordinating fine-grained CPU and memory scaling.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016
EditorsIan Foster, Nimish Radia, Ian Foster
PublisherIEEE Computer Society
Pages124-131
Number of pages8
ISBN (Electronic)9781509026197
DOIs
StatePublished - Jan 17 2017
Event9th International Conference on Cloud Computing, CLOUD 2016 - San Francisco, United States
Duration: Jun 27 2016Jul 2 2016

Publication series

NameIEEE International Conference on Cloud Computing, CLOUD
ISSN (Print)2159-6182
ISSN (Electronic)2159-6190

Other

Other9th International Conference on Cloud Computing, CLOUD 2016
CountryUnited States
CitySan Francisco
Period6/27/167/2/16

Fingerprint

Data storage equipment
Interfaces (computer)
Program processors
Ecosystems
Costs
Feedback
Controllers
Virtual machine

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Information Systems
  • Software

Cite this

Wang, C., Gupta, A., & Urgaonkar, B. (2017). Fine-grained resource scaling in a public cloud: A Tenant's perspective. In I. Foster, N. Radia, & I. Foster (Eds.), Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016 (pp. 124-131). [7820263] (IEEE International Conference on Cloud Computing, CLOUD). IEEE Computer Society. https://doi.org/10.1109/CLOUD.2016.24
Wang, Cheng ; Gupta, Aayush ; Urgaonkar, Bhuvan. / Fine-grained resource scaling in a public cloud : A Tenant's perspective. Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016. editor / Ian Foster ; Nimish Radia ; Ian Foster. IEEE Computer Society, 2017. pp. 124-131 (IEEE International Conference on Cloud Computing, CLOUD).
@inproceedings{b36978dacc114d64bd9f0c233990511a,
title = "Fine-grained resource scaling in a public cloud: A Tenant's perspective",
abstract = "Growing tenant workload needs and an increasingly competitive market will force cloud providers to operate their data centers at significantly higher utilization levels than seen today. We argue that a key enabler of such cloud ecosystems would be facilities for tenants to engage in fine-grained resource scaling in addition to those offered by current providers. The basic unit of resource scaling exposed by current cloud providers is the canonical interface of virtual machines (VMs) with relatively static resource capacities. This paper describes opportunities and challenges in augmenting this interface to also include finegrained scaling of CPU and memory within an already procured VM. Qualitative arguments for why this would offer cost benefits for both the provider and its tenants are presented. We focus on the cost-effective operation of a tenant in such an environment via the design of a feedback controller. The efficacy of our ideas is illustrated by implementing a case study in a Memcached tenant workload. Our results are promising and point to an interesting and broad area for further research-e.g., with the real-world workload in our evaluation, up to 50{\%} utility improvement can be achieved by just applying memory scaling; a further 66{\%} improvement can be achieved by coordinating fine-grained CPU and memory scaling.",
author = "Cheng Wang and Aayush Gupta and Bhuvan Urgaonkar",
year = "2017",
month = "1",
day = "17",
doi = "10.1109/CLOUD.2016.24",
language = "English (US)",
series = "IEEE International Conference on Cloud Computing, CLOUD",
publisher = "IEEE Computer Society",
pages = "124--131",
editor = "Ian Foster and Nimish Radia and Ian Foster",
booktitle = "Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016",
address = "United States",

}

Wang, C, Gupta, A & Urgaonkar, B 2017, Fine-grained resource scaling in a public cloud: A Tenant's perspective. in I Foster, N Radia & I Foster (eds), Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016., 7820263, IEEE International Conference on Cloud Computing, CLOUD, IEEE Computer Society, pp. 124-131, 9th International Conference on Cloud Computing, CLOUD 2016, San Francisco, United States, 6/27/16. https://doi.org/10.1109/CLOUD.2016.24

Fine-grained resource scaling in a public cloud : A Tenant's perspective. / Wang, Cheng; Gupta, Aayush; Urgaonkar, Bhuvan.

Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016. ed. / Ian Foster; Nimish Radia; Ian Foster. IEEE Computer Society, 2017. p. 124-131 7820263 (IEEE International Conference on Cloud Computing, CLOUD).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Fine-grained resource scaling in a public cloud

T2 - A Tenant's perspective

AU - Wang, Cheng

AU - Gupta, Aayush

AU - Urgaonkar, Bhuvan

PY - 2017/1/17

Y1 - 2017/1/17

N2 - Growing tenant workload needs and an increasingly competitive market will force cloud providers to operate their data centers at significantly higher utilization levels than seen today. We argue that a key enabler of such cloud ecosystems would be facilities for tenants to engage in fine-grained resource scaling in addition to those offered by current providers. The basic unit of resource scaling exposed by current cloud providers is the canonical interface of virtual machines (VMs) with relatively static resource capacities. This paper describes opportunities and challenges in augmenting this interface to also include finegrained scaling of CPU and memory within an already procured VM. Qualitative arguments for why this would offer cost benefits for both the provider and its tenants are presented. We focus on the cost-effective operation of a tenant in such an environment via the design of a feedback controller. The efficacy of our ideas is illustrated by implementing a case study in a Memcached tenant workload. Our results are promising and point to an interesting and broad area for further research-e.g., with the real-world workload in our evaluation, up to 50% utility improvement can be achieved by just applying memory scaling; a further 66% improvement can be achieved by coordinating fine-grained CPU and memory scaling.

AB - Growing tenant workload needs and an increasingly competitive market will force cloud providers to operate their data centers at significantly higher utilization levels than seen today. We argue that a key enabler of such cloud ecosystems would be facilities for tenants to engage in fine-grained resource scaling in addition to those offered by current providers. The basic unit of resource scaling exposed by current cloud providers is the canonical interface of virtual machines (VMs) with relatively static resource capacities. This paper describes opportunities and challenges in augmenting this interface to also include finegrained scaling of CPU and memory within an already procured VM. Qualitative arguments for why this would offer cost benefits for both the provider and its tenants are presented. We focus on the cost-effective operation of a tenant in such an environment via the design of a feedback controller. The efficacy of our ideas is illustrated by implementing a case study in a Memcached tenant workload. Our results are promising and point to an interesting and broad area for further research-e.g., with the real-world workload in our evaluation, up to 50% utility improvement can be achieved by just applying memory scaling; a further 66% improvement can be achieved by coordinating fine-grained CPU and memory scaling.

UR - http://www.scopus.com/inward/record.url?scp=85014159458&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85014159458&partnerID=8YFLogxK

U2 - 10.1109/CLOUD.2016.24

DO - 10.1109/CLOUD.2016.24

M3 - Conference contribution

AN - SCOPUS:85014159458

T3 - IEEE International Conference on Cloud Computing, CLOUD

SP - 124

EP - 131

BT - Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016

A2 - Foster, Ian

A2 - Radia, Nimish

A2 - Foster, Ian

PB - IEEE Computer Society

ER -

Wang C, Gupta A, Urgaonkar B. Fine-grained resource scaling in a public cloud: A Tenant's perspective. In Foster I, Radia N, Foster I, editors, Proceedings - 2016 IEEE 9th International Conference on Cloud Computing, CLOUD 2016. IEEE Computer Society. 2017. p. 124-131. 7820263. (IEEE International Conference on Cloud Computing, CLOUD). https://doi.org/10.1109/CLOUD.2016.24