Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP

John C. Hayes, Michael L. Norman, Robert A. Fiedler, James O. Bordner, Pak Shing Li, Stephen E. Clark, Asif Ud-Doula, Mordecai Mark Mac Low

Research output: Contribution to journalArticle

201 Citations (Scopus)

Abstract

This paper describes ZEUS-MP, a multiphysics, massively parallel, message-passing implementation of the ZEUS code. ZEUS-MP differs significantly from the thoroughly documented ZEUS-2D code, the completely undocumented (in peer-reviewed literature) ZEUS-3D code, and a marginally documented "version 1" of ZEUS-MP first distributed publicly in 1999. ZEUS-MP offers an MHD algorithm that is better suited for multidimensional flows than the ZEUS-2D module by virtue of modifications to the method of characteristics scheme first suggested by Hawley & Stone. This MHD module is shown to compare quite favorably to the TVD scheme described by Ryu et al. ZEUS-MP is the first publicly available ZEUS code to allow the advection of multiple chemical (or nuclear) species. Radiation hydrodynamic simulations are enabled via an implicit flux-limited radiation diffusion (FLD) module. The hydrodynamic, MHD, and FLD modules can be used, singly or in concert, in one, two, or three space dimensions. In addition, so-called 1.5D and 2.5D grids, in which the "half-D" denotes a symmetry axis along which a constant but nonzero value of velocity or magnetic field is evolved, are supported. Self-gravity can be included either through the assumption of a GM/r potential or through a solution of Poisson's equation using one of three linear solver packages (conjugate gradient, multigrid, and FFT) provided for that purpose. Point-mass potentials are also supported. Because ZEUS-MP is designed for large simulations on parallel computing platforms, considerable attention is paid to the parallel performance characteristics of each module in the code. Strong-scaling tests involving pure hydrodynamics (with and without self-gravity), MHD, and RHD are performed in which large problems (256 3 zones) are distributed among as many as 1024 processors of an IBM SP3. Parallel efficiency is a strong function of the amount of communication required between processors in a given algorithm, but all modules are shown to scale well on up to 1024 processors for the chosen fixed problem size.

Original languageEnglish (US)
Pages (from-to)188-228
Number of pages41
JournalAstrophysical Journal, Supplement Series
Volume165
Issue number1
DOIs
StatePublished - Jul 1 2006

Fingerprint

modules
hydrodynamics
central processing units
gravity
radiation
parallel computing
TVD schemes
gravitation
method of characteristics
fast Fourier transformations
simulation
symmetry
messages
Poisson equation
advection
code
communication
magnetic field
platforms
velocity distribution

All Science Journal Classification (ASJC) codes

  • Astronomy and Astrophysics
  • Space and Planetary Science

Cite this

Hayes, J. C., Norman, M. L., Fiedler, R. A., Bordner, J. O., Li, P. S., Clark, S. E., ... Low, M. M. M. (2006). Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP. Astrophysical Journal, Supplement Series, 165(1), 188-228. https://doi.org/10.1086/504594
Hayes, John C. ; Norman, Michael L. ; Fiedler, Robert A. ; Bordner, James O. ; Li, Pak Shing ; Clark, Stephen E. ; Ud-Doula, Asif ; Low, Mordecai Mark Mac. / Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP. In: Astrophysical Journal, Supplement Series. 2006 ; Vol. 165, No. 1. pp. 188-228.
@article{f52aa351f55e44ea903ab66371767de1,
title = "Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP",
abstract = "This paper describes ZEUS-MP, a multiphysics, massively parallel, message-passing implementation of the ZEUS code. ZEUS-MP differs significantly from the thoroughly documented ZEUS-2D code, the completely undocumented (in peer-reviewed literature) ZEUS-3D code, and a marginally documented {"}version 1{"} of ZEUS-MP first distributed publicly in 1999. ZEUS-MP offers an MHD algorithm that is better suited for multidimensional flows than the ZEUS-2D module by virtue of modifications to the method of characteristics scheme first suggested by Hawley & Stone. This MHD module is shown to compare quite favorably to the TVD scheme described by Ryu et al. ZEUS-MP is the first publicly available ZEUS code to allow the advection of multiple chemical (or nuclear) species. Radiation hydrodynamic simulations are enabled via an implicit flux-limited radiation diffusion (FLD) module. The hydrodynamic, MHD, and FLD modules can be used, singly or in concert, in one, two, or three space dimensions. In addition, so-called 1.5D and 2.5D grids, in which the {"}half-D{"} denotes a symmetry axis along which a constant but nonzero value of velocity or magnetic field is evolved, are supported. Self-gravity can be included either through the assumption of a GM/r potential or through a solution of Poisson's equation using one of three linear solver packages (conjugate gradient, multigrid, and FFT) provided for that purpose. Point-mass potentials are also supported. Because ZEUS-MP is designed for large simulations on parallel computing platforms, considerable attention is paid to the parallel performance characteristics of each module in the code. Strong-scaling tests involving pure hydrodynamics (with and without self-gravity), MHD, and RHD are performed in which large problems (256 3 zones) are distributed among as many as 1024 processors of an IBM SP3. Parallel efficiency is a strong function of the amount of communication required between processors in a given algorithm, but all modules are shown to scale well on up to 1024 processors for the chosen fixed problem size.",
author = "Hayes, {John C.} and Norman, {Michael L.} and Fiedler, {Robert A.} and Bordner, {James O.} and Li, {Pak Shing} and Clark, {Stephen E.} and Asif Ud-Doula and Low, {Mordecai Mark Mac}",
year = "2006",
month = "7",
day = "1",
doi = "10.1086/504594",
language = "English (US)",
volume = "165",
pages = "188--228",
journal = "Astrophysical Journal, Supplement Series",
issn = "0067-0049",
publisher = "IOP Publishing Ltd.",
number = "1",

}

Hayes, JC, Norman, ML, Fiedler, RA, Bordner, JO, Li, PS, Clark, SE, Ud-Doula, A & Low, MMM 2006, 'Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP', Astrophysical Journal, Supplement Series, vol. 165, no. 1, pp. 188-228. https://doi.org/10.1086/504594

Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP. / Hayes, John C.; Norman, Michael L.; Fiedler, Robert A.; Bordner, James O.; Li, Pak Shing; Clark, Stephen E.; Ud-Doula, Asif; Low, Mordecai Mark Mac.

In: Astrophysical Journal, Supplement Series, Vol. 165, No. 1, 01.07.2006, p. 188-228.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP

AU - Hayes, John C.

AU - Norman, Michael L.

AU - Fiedler, Robert A.

AU - Bordner, James O.

AU - Li, Pak Shing

AU - Clark, Stephen E.

AU - Ud-Doula, Asif

AU - Low, Mordecai Mark Mac

PY - 2006/7/1

Y1 - 2006/7/1

N2 - This paper describes ZEUS-MP, a multiphysics, massively parallel, message-passing implementation of the ZEUS code. ZEUS-MP differs significantly from the thoroughly documented ZEUS-2D code, the completely undocumented (in peer-reviewed literature) ZEUS-3D code, and a marginally documented "version 1" of ZEUS-MP first distributed publicly in 1999. ZEUS-MP offers an MHD algorithm that is better suited for multidimensional flows than the ZEUS-2D module by virtue of modifications to the method of characteristics scheme first suggested by Hawley & Stone. This MHD module is shown to compare quite favorably to the TVD scheme described by Ryu et al. ZEUS-MP is the first publicly available ZEUS code to allow the advection of multiple chemical (or nuclear) species. Radiation hydrodynamic simulations are enabled via an implicit flux-limited radiation diffusion (FLD) module. The hydrodynamic, MHD, and FLD modules can be used, singly or in concert, in one, two, or three space dimensions. In addition, so-called 1.5D and 2.5D grids, in which the "half-D" denotes a symmetry axis along which a constant but nonzero value of velocity or magnetic field is evolved, are supported. Self-gravity can be included either through the assumption of a GM/r potential or through a solution of Poisson's equation using one of three linear solver packages (conjugate gradient, multigrid, and FFT) provided for that purpose. Point-mass potentials are also supported. Because ZEUS-MP is designed for large simulations on parallel computing platforms, considerable attention is paid to the parallel performance characteristics of each module in the code. Strong-scaling tests involving pure hydrodynamics (with and without self-gravity), MHD, and RHD are performed in which large problems (256 3 zones) are distributed among as many as 1024 processors of an IBM SP3. Parallel efficiency is a strong function of the amount of communication required between processors in a given algorithm, but all modules are shown to scale well on up to 1024 processors for the chosen fixed problem size.

AB - This paper describes ZEUS-MP, a multiphysics, massively parallel, message-passing implementation of the ZEUS code. ZEUS-MP differs significantly from the thoroughly documented ZEUS-2D code, the completely undocumented (in peer-reviewed literature) ZEUS-3D code, and a marginally documented "version 1" of ZEUS-MP first distributed publicly in 1999. ZEUS-MP offers an MHD algorithm that is better suited for multidimensional flows than the ZEUS-2D module by virtue of modifications to the method of characteristics scheme first suggested by Hawley & Stone. This MHD module is shown to compare quite favorably to the TVD scheme described by Ryu et al. ZEUS-MP is the first publicly available ZEUS code to allow the advection of multiple chemical (or nuclear) species. Radiation hydrodynamic simulations are enabled via an implicit flux-limited radiation diffusion (FLD) module. The hydrodynamic, MHD, and FLD modules can be used, singly or in concert, in one, two, or three space dimensions. In addition, so-called 1.5D and 2.5D grids, in which the "half-D" denotes a symmetry axis along which a constant but nonzero value of velocity or magnetic field is evolved, are supported. Self-gravity can be included either through the assumption of a GM/r potential or through a solution of Poisson's equation using one of three linear solver packages (conjugate gradient, multigrid, and FFT) provided for that purpose. Point-mass potentials are also supported. Because ZEUS-MP is designed for large simulations on parallel computing platforms, considerable attention is paid to the parallel performance characteristics of each module in the code. Strong-scaling tests involving pure hydrodynamics (with and without self-gravity), MHD, and RHD are performed in which large problems (256 3 zones) are distributed among as many as 1024 processors of an IBM SP3. Parallel efficiency is a strong function of the amount of communication required between processors in a given algorithm, but all modules are shown to scale well on up to 1024 processors for the chosen fixed problem size.

UR - http://www.scopus.com/inward/record.url?scp=33748521208&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33748521208&partnerID=8YFLogxK

U2 - 10.1086/504594

DO - 10.1086/504594

M3 - Article

AN - SCOPUS:33748521208

VL - 165

SP - 188

EP - 228

JO - Astrophysical Journal, Supplement Series

JF - Astrophysical Journal, Supplement Series

SN - 0067-0049

IS - 1

ER -

Hayes JC, Norman ML, Fiedler RA, Bordner JO, Li PS, Clark SE et al. Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP. Astrophysical Journal, Supplement Series. 2006 Jul 1;165(1):188-228. https://doi.org/10.1086/504594