ACE: Abstracting, characterizing and exploiting datacenter power demands

Di Wang, Chuangang Ren, Sriram Govindan, Anand Sivasubramaniam, Bhuvan Urgaonkar, Aman Kansal, Kushagra Vaid

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

Peak power management of datacenters has tremendous cost implications. While numerous mechanisms have been proposed to cap power consumption, real datacenter power consumption data is scarce. Prior studies have either used a small set of applications and/or servers, or presented data that is at an aggregate scale from which it is difficult to design and evaluate new and existing optimizations. To address this gap, we collect power measurement data at multiple spatial and fine-grained temporal resolutions from several geo-distributed datacenters of Microsoft corporation over 6 months. We conduct aggregate analysis of this data to study its statistical properties. We find evidence of self-similarity in power demands, statistical multiplexing effects, and correlations with the cooling power that caters to the IT equipment. With workload characterization a key ingredient for systems design and evaluation, we note the importance of better abstractions for capturing power demands, in the form of peaks and valleys. We identify attributes for peaks and valleys, and important correlations across these attributes that can influence the choice and effectiveness of different power capping techniques. We characterize these attributes and their correlations, showing the burstiness of small duration peaks, and the importance of not ignoring the rare but more stringent or long peaks. The correlations between peaks and valleys suggest the need for techniques to aggregate and collectively handle them. With the wide scope of exploitability of such characteristics for power provisioning and optimizations, we illustrate its benefits with two specific case studies. The first shows how peaks can be differentially handled based on our peak and valley characterization using existing approaches, rather than a one-size-fits-all solution. The second illustrates a simple capacity provisioning strategy for energy storage using the peak and valley characteristics.

Original languageEnglish (US)
Title of host publicationProceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013
PublisherIEEE Computer Society
Pages44-55
Number of pages12
ISBN (Print)9781479905539
DOIs
StatePublished - Jan 1 2013
Event2013 IEEE International Symposium on Workload Characterization, IISWC 2013 - Portland, OR, United States
Duration: Sep 22 2013Sep 24 2013

Publication series

NameProceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013

Other

Other2013 IEEE International Symposium on Workload Characterization, IISWC 2013
CountryUnited States
CityPortland, OR
Period9/22/139/24/13

Fingerprint

Electric power utilization
Multiplexing
Energy storage
Servers
Systems analysis
Cooling
Costs
Industry
Power management

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this

Wang, D., Ren, C., Govindan, S., Sivasubramaniam, A., Urgaonkar, B., Kansal, A., & Vaid, K. (2013). ACE: Abstracting, characterizing and exploiting datacenter power demands. In Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013 (pp. 44-55). [6704669] (Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013). IEEE Computer Society. https://doi.org/10.1109/IISWC.2013.6704669
Wang, Di ; Ren, Chuangang ; Govindan, Sriram ; Sivasubramaniam, Anand ; Urgaonkar, Bhuvan ; Kansal, Aman ; Vaid, Kushagra. / ACE : Abstracting, characterizing and exploiting datacenter power demands. Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013. IEEE Computer Society, 2013. pp. 44-55 (Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013).
@inproceedings{2042439f1a63490f978a6fd0a52868e4,
title = "ACE: Abstracting, characterizing and exploiting datacenter power demands",
abstract = "Peak power management of datacenters has tremendous cost implications. While numerous mechanisms have been proposed to cap power consumption, real datacenter power consumption data is scarce. Prior studies have either used a small set of applications and/or servers, or presented data that is at an aggregate scale from which it is difficult to design and evaluate new and existing optimizations. To address this gap, we collect power measurement data at multiple spatial and fine-grained temporal resolutions from several geo-distributed datacenters of Microsoft corporation over 6 months. We conduct aggregate analysis of this data to study its statistical properties. We find evidence of self-similarity in power demands, statistical multiplexing effects, and correlations with the cooling power that caters to the IT equipment. With workload characterization a key ingredient for systems design and evaluation, we note the importance of better abstractions for capturing power demands, in the form of peaks and valleys. We identify attributes for peaks and valleys, and important correlations across these attributes that can influence the choice and effectiveness of different power capping techniques. We characterize these attributes and their correlations, showing the burstiness of small duration peaks, and the importance of not ignoring the rare but more stringent or long peaks. The correlations between peaks and valleys suggest the need for techniques to aggregate and collectively handle them. With the wide scope of exploitability of such characteristics for power provisioning and optimizations, we illustrate its benefits with two specific case studies. The first shows how peaks can be differentially handled based on our peak and valley characterization using existing approaches, rather than a one-size-fits-all solution. The second illustrates a simple capacity provisioning strategy for energy storage using the peak and valley characteristics.",
author = "Di Wang and Chuangang Ren and Sriram Govindan and Anand Sivasubramaniam and Bhuvan Urgaonkar and Aman Kansal and Kushagra Vaid",
year = "2013",
month = "1",
day = "1",
doi = "10.1109/IISWC.2013.6704669",
language = "English (US)",
isbn = "9781479905539",
series = "Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013",
publisher = "IEEE Computer Society",
pages = "44--55",
booktitle = "Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013",
address = "United States",

}

Wang, D, Ren, C, Govindan, S, Sivasubramaniam, A, Urgaonkar, B, Kansal, A & Vaid, K 2013, ACE: Abstracting, characterizing and exploiting datacenter power demands. in Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013., 6704669, Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013, IEEE Computer Society, pp. 44-55, 2013 IEEE International Symposium on Workload Characterization, IISWC 2013, Portland, OR, United States, 9/22/13. https://doi.org/10.1109/IISWC.2013.6704669

ACE : Abstracting, characterizing and exploiting datacenter power demands. / Wang, Di; Ren, Chuangang; Govindan, Sriram; Sivasubramaniam, Anand; Urgaonkar, Bhuvan; Kansal, Aman; Vaid, Kushagra.

Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013. IEEE Computer Society, 2013. p. 44-55 6704669 (Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - ACE

T2 - Abstracting, characterizing and exploiting datacenter power demands

AU - Wang, Di

AU - Ren, Chuangang

AU - Govindan, Sriram

AU - Sivasubramaniam, Anand

AU - Urgaonkar, Bhuvan

AU - Kansal, Aman

AU - Vaid, Kushagra

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Peak power management of datacenters has tremendous cost implications. While numerous mechanisms have been proposed to cap power consumption, real datacenter power consumption data is scarce. Prior studies have either used a small set of applications and/or servers, or presented data that is at an aggregate scale from which it is difficult to design and evaluate new and existing optimizations. To address this gap, we collect power measurement data at multiple spatial and fine-grained temporal resolutions from several geo-distributed datacenters of Microsoft corporation over 6 months. We conduct aggregate analysis of this data to study its statistical properties. We find evidence of self-similarity in power demands, statistical multiplexing effects, and correlations with the cooling power that caters to the IT equipment. With workload characterization a key ingredient for systems design and evaluation, we note the importance of better abstractions for capturing power demands, in the form of peaks and valleys. We identify attributes for peaks and valleys, and important correlations across these attributes that can influence the choice and effectiveness of different power capping techniques. We characterize these attributes and their correlations, showing the burstiness of small duration peaks, and the importance of not ignoring the rare but more stringent or long peaks. The correlations between peaks and valleys suggest the need for techniques to aggregate and collectively handle them. With the wide scope of exploitability of such characteristics for power provisioning and optimizations, we illustrate its benefits with two specific case studies. The first shows how peaks can be differentially handled based on our peak and valley characterization using existing approaches, rather than a one-size-fits-all solution. The second illustrates a simple capacity provisioning strategy for energy storage using the peak and valley characteristics.

AB - Peak power management of datacenters has tremendous cost implications. While numerous mechanisms have been proposed to cap power consumption, real datacenter power consumption data is scarce. Prior studies have either used a small set of applications and/or servers, or presented data that is at an aggregate scale from which it is difficult to design and evaluate new and existing optimizations. To address this gap, we collect power measurement data at multiple spatial and fine-grained temporal resolutions from several geo-distributed datacenters of Microsoft corporation over 6 months. We conduct aggregate analysis of this data to study its statistical properties. We find evidence of self-similarity in power demands, statistical multiplexing effects, and correlations with the cooling power that caters to the IT equipment. With workload characterization a key ingredient for systems design and evaluation, we note the importance of better abstractions for capturing power demands, in the form of peaks and valleys. We identify attributes for peaks and valleys, and important correlations across these attributes that can influence the choice and effectiveness of different power capping techniques. We characterize these attributes and their correlations, showing the burstiness of small duration peaks, and the importance of not ignoring the rare but more stringent or long peaks. The correlations between peaks and valleys suggest the need for techniques to aggregate and collectively handle them. With the wide scope of exploitability of such characteristics for power provisioning and optimizations, we illustrate its benefits with two specific case studies. The first shows how peaks can be differentially handled based on our peak and valley characterization using existing approaches, rather than a one-size-fits-all solution. The second illustrates a simple capacity provisioning strategy for energy storage using the peak and valley characteristics.

UR - http://www.scopus.com/inward/record.url?scp=84893523616&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893523616&partnerID=8YFLogxK

U2 - 10.1109/IISWC.2013.6704669

DO - 10.1109/IISWC.2013.6704669

M3 - Conference contribution

AN - SCOPUS:84893523616

SN - 9781479905539

T3 - Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013

SP - 44

EP - 55

BT - Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013

PB - IEEE Computer Society

ER -

Wang D, Ren C, Govindan S, Sivasubramaniam A, Urgaonkar B, Kansal A et al. ACE: Abstracting, characterizing and exploiting datacenter power demands. In Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013. IEEE Computer Society. 2013. p. 44-55. 6704669. (Proceedings - 2013 IEEE International Symposium on Workload Characterization, IISWC 2013). https://doi.org/10.1109/IISWC.2013.6704669