Coscheduling in clusters: Is it a viable alternative?

Gyu Sang Choi, Jin Ha Kim, Deniz Ersoz, Andy B. Yoo, Chita R. Das

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

In this paper, we conduct an in-depth evaluation of a broad spectrum of scheduling alternatives for clusters. These include the widely used batch scheduling, local scheduling, gang scheduling, all prior communication-driven coscheduling algorithms (Dynamic Coscheduling (DCS), Spin Block (SB), Periodic Boost (PB), and Co-ordinated Coscheduling (CC)) and a newly proposed HYBRID Coscheduling algorithm on a 16-node, Myrinet-connected Linux cluster. Performance and energy measurements using several NAS, LLNL and ANL benchmarks on the Linux cluster provide several interesting conclusions. First, although batch scheduling is currently used in most clusters, all blocking-based Coscheduling techniques such as SB, CC and HYBRID and the gang scheduling can provide much better performance even in a dedicated cluster platform. Second, in contrast to some of the prior studies, we observe that blocking-based schemes like SB and HYBRID can provide better performance than spin-based techniques like PB on a Linux platform. Third, the proposed HYBRID scheduling provides the best performance-energy behavior and can be implemented on any cluster with little effort. All these results suggest that blocking-based Coscheduling techniques are viable candidates to be used in clusters for significant performance-energy benefits.

Original languageEnglish (US)
Title of host publicationIEEE/ACM SC2004 Conference - Bridging Communities, Proceedings
Pages69-81
Number of pages13
StatePublished - Dec 1 2004
EventIEEE/ACM SC2004 Conference - Bridging Communities - Pittsburgh, PA, United States
Duration: Nov 6 2004Nov 12 2004

Publication series

NameIEEE/ACM SC2004 Conference, Proceedings

Other

OtherIEEE/ACM SC2004 Conference - Bridging Communities
CountryUnited States
CityPittsburgh, PA
Period11/6/0411/12/04

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Choi, G. S., Kim, J. H., Ersoz, D., Yoo, A. B., & Das, C. R. (2004). Coscheduling in clusters: Is it a viable alternative? In IEEE/ACM SC2004 Conference - Bridging Communities, Proceedings (pp. 69-81). (IEEE/ACM SC2004 Conference, Proceedings).