Improving response time in cluster-based Web servers through coscheduling

Jin Ha Kim, Gyu Sang Choi, Deniz Ersoz, Chita R. Das

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

In this paper, we investigate the feasibility of minimizing the response time of a Web server by exploiting the advantages of both user-level communication and coscheduling. We, thus, propose a coscheduled server model, based on the PRESS design where the remote cache accesses can be coscheduled on different nodes to reduce the response time. We experiment this concept using two known coscheduling techniques, called Dynamic Coscheduling (DCS) and DCS with immediate blocking. Extensive simulation of four server models (PRESS over TCP/IP, PRESS over VIA, coscheduled PRESS model with DCS, and with DCS and blocking) using 16-node and 32-node cluster configurations indicates that the average response time of a distributed server can be minimized significantly by coscheduling the communicating processes. The use of the DCS scheme reduced the average latency up to 80%, on an average 40%, compared to the PRESS over VIA model that uses only user-level communication, and by order of magnitude compared to the TCP/IP model. The throughput of the three user-level communication models is at least 25% better compared to the PRESS over TCP/IP model. Experiments with varying file size and cache size also confirmed the advantage of using a coscheduling mechanism for improving the response time behavior.

Original languageEnglish (US)
Title of host publicationProceedings - 18th International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM)
Pages1237-1246
Number of pages10
StatePublished - Dec 1 2004
EventProceedings - 18th International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM) - Santa Fe, NM, United States
Duration: Apr 26 2004Apr 30 2004

Publication series

NameProceedings - International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM)
Volume18

Other

OtherProceedings - 18th International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM)
CountryUnited States
CitySanta Fe, NM
Period4/26/044/30/04

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Kim, J. H., Choi, G. S., Ersoz, D., & Das, C. R. (2004). Improving response time in cluster-based Web servers through coscheduling. In Proceedings - 18th International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM) (pp. 1237-1246). (Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2004 (Abstracts and CD-ROM); Vol. 18).