Distributed workload and response time management for web applications

Shengzhi Zhang, Haishan Wu, Wenjie Wang, Bo Yang, Peng Liu, Athanasios V. Vasilakos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Managing workload for large scale web applications is a fundamental task for satisfactory quality of service, low management and operation cost. In this paper, we present SCOPS, a system of distributed workload management to achieve service differentiation and overload protection in such large scale deployment. Our system splits the workload management logic into distributed components on each back-end server and front-end proxy. The control solution is designed to protect the backend server from overloading and to achieve both efficient usage of system resource and service differentiation by employing a unique optimization target. The control components are automatically organized based on the flow of workloads, such that management overhead is minimized. SCOPS is extremely flexible because it requires no source code changes to host OS, application servers, or web applications. Additionally, the distributed design makes it scalable and robust for cloud scale server deployment. Experiments with our implementation confirm SCOPS's performance with dynamic heavy workload, incurring neglectable runtime overhead. More importantly, SCOPS also ensures fault-tolerance and fast convergence to system failures.

Original languageEnglish (US)
Title of host publication2011 7th International Conference on Network and Service Management, CNSM 2011
StatePublished - Dec 1 2011
Event2011 7th International Conference on Network and Service Management, CNSM 2011 - Paris, France
Duration: Oct 24 2011Oct 28 2011

Publication series

Name2011 7th International Conference on Network and Service Management, CNSM 2011

Other

Other2011 7th International Conference on Network and Service Management, CNSM 2011
CountryFrance
CityParis
Period10/24/1110/28/11

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Distributed workload and response time management for web applications'. Together they form a unique fingerprint.

  • Cite this

    Zhang, S., Wu, H., Wang, W., Yang, B., Liu, P., & Vasilakos, A. V. (2011). Distributed workload and response time management for web applications. In 2011 7th International Conference on Network and Service Management, CNSM 2011 [6103955] (2011 7th International Conference on Network and Service Management, CNSM 2011).