Resource overbooking and application profiling in shared hosting platforms

Bhuvan Urgaonkar, Prashant Shenoy, Timothy Roscoet

Research output: Contribution to journalConference articlepeer-review

123 Scopus citations

Abstract

In this paper, we present techniques for provisioning CPU and network resources in shared hosting platforms running potentially antagonistic third-party applications. The primary contribution of our work is to demonstrate the feasibility and benefits of overbooking resources in shared platforms, to maximize the platform yield: the revenue generated by the available resources. We do this by first deriving an accurate estimate of application resource needs by profiling applications on dedicated nodes, and then using these profiles to guide the placement of application components onto shared nodes. By overbooking cluster resources in a controlled fashion, our platform can provide performance guarantees to applications even when overbooked, and combine these techniques with commonly used QoS resource allocation mechanisms to provide application isolation and performance guarantees at run-time. When compared to provisioning based on the worst-case, the efficiency (and consequently revenue) benefits from controlled overbooking of resources can be dramatic. Specifically, experiments on our Linux cluster implementation indicate that overbooking resources by as little as 1% can increase the utilization of the cluster by a factor of two, and a 5% overbooking yields a 300-500% improvement, while still providing useful resource guarantees to applications.

Original languageEnglish (US)
Pages (from-to)239-254
Number of pages16
JournalOperating Systems Review (ACM)
Volume36
Issue numberSpecial Issue
DOIs
StatePublished - Dec 31 2002
Event5th Symposium on Operating Systems Design and Implementation, OSDI 2002 - Boston, United States
Duration: Dec 9 2002Dec 11 2002

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Resource overbooking and application profiling in shared hosting platforms'. Together they form a unique fingerprint.

Cite this