Simulation-based study of scheduling mechanisms for a dynamic cluster environment

Yanyong Zhang, Anand Sivasubramaniam, Jose Moreira, Hubertus Franke

Research output: Contribution to conferencePaper

13 Scopus citations

Abstract

Scheduling of processes onto processors of a parallel machine has always been an important and challenging area of research. The issue becomes even more crucial and difficult as we gradually progress to the use of off-the-shelf workstations, operating systems, and high bandwidth networks to build cost-effective clusters for demanding applications. Clusters are gaining acceptance not just in scientific applications that need supercomputing power, but also in domains such as databases, web service and multimedia, which place diverse Quality-of-Service (QoS) demands on the underlying system. Further, these applications have diverse characteristics in terms of their computation, communication and I/O requirements, making conventional parallel scheduling solutions, such as space sharing or coscheduling, an unattractive option. At the same time, leaving it to the native operating system of each node to make decisions independently can lead to ineffective use of system resources whenever there is communication. Instead, an emerging class of dynamic coscheduling mechanisms, that attempt to take remedial actions to guide the system towards coscheduled execution without requiring explicit synchronization, offer a lot of promise for cluster scheduling. Using a detailed simulator, this paper evaluates the pros and cons of different dynamic coscheduling alternatives, while comparing their advantages over traditional coscheduling (and not performing any coordinated scheduling at all). The impact of dynamic job arrivals, job characteristics and different system parameters on these alternatives are evaluated in terms of several performance criteria.

Original languageEnglish (US)
Pages100-109
Number of pages10
StatePublished - Jan 1 2000
Event2000 International Conference on Supercomputing - Santa Fe, NM, USA
Duration: May 8 2000May 11 2000

Other

Other2000 International Conference on Supercomputing
CitySanta Fe, NM, USA
Period5/8/005/11/00

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Zhang, Y., Sivasubramaniam, A., Moreira, J., & Franke, H. (2000). Simulation-based study of scheduling mechanisms for a dynamic cluster environment. 100-109. Paper presented at 2000 International Conference on Supercomputing, Santa Fe, NM, USA, .