Cosmic microwave background map-making at the petascale and beyond

Rajesh Sudarsan, Julian Borrill, Christopher Cantalupo, Theodore Kisner, Kamesh Madduri, Leonid Oliker, Yili Zheng, Horst Simon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The analysis of Cosmic Microwave Background (CMB) observations is a long-standing computational challenge, driven by the exponential growth in the size of the data sets being gathered. Since this growth is projected to continue for at least the next decade, it will be critical to extend the analysis algorithms and their implementations to peta-scale high performance computing (HPC) systems and beyond. The most computationally intensive part of the analysis is generating and reducing Monte Carlo realizations of an experiment's data. In this work we take the current state-of-the-art simulation and mapping software and investigate its performance when pushed to tens of thousands of cores on a range of leading HPC systems, in particular focusing on the communication bottleneck that emerges at high concurrencies. We present a new communication strategy that removes this bottleneck, allowing for CMB analyses of unprecedented scale and hence fidelity. Experimental results show a communication speedup of up to 116x using our alternative strategy.

Original languageEnglish (US)
Title of host publicationICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing
Pages305-316
Number of pages12
DOIs
StatePublished - Jun 30 2011
Event25th ACM International Conference on Supercomputing, ICS 2011 - Tucson, AZ, United States
Duration: May 31 2011Jun 4 2011

Publication series

NameProceedings of the International Conference on Supercomputing

Other

Other25th ACM International Conference on Supercomputing, ICS 2011
CountryUnited States
CityTucson, AZ
Period5/31/116/4/11

Fingerprint

Microwaves
Communication
Experiments

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Sudarsan, R., Borrill, J., Cantalupo, C., Kisner, T., Madduri, K., Oliker, L., ... Simon, H. (2011). Cosmic microwave background map-making at the petascale and beyond. In ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing (pp. 305-316). (Proceedings of the International Conference on Supercomputing). https://doi.org/10.1145/1995896.1995944
Sudarsan, Rajesh ; Borrill, Julian ; Cantalupo, Christopher ; Kisner, Theodore ; Madduri, Kamesh ; Oliker, Leonid ; Zheng, Yili ; Simon, Horst. / Cosmic microwave background map-making at the petascale and beyond. ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing. 2011. pp. 305-316 (Proceedings of the International Conference on Supercomputing).
@inproceedings{9caa90692f6648188f87d8ed4710ff04,
title = "Cosmic microwave background map-making at the petascale and beyond",
abstract = "The analysis of Cosmic Microwave Background (CMB) observations is a long-standing computational challenge, driven by the exponential growth in the size of the data sets being gathered. Since this growth is projected to continue for at least the next decade, it will be critical to extend the analysis algorithms and their implementations to peta-scale high performance computing (HPC) systems and beyond. The most computationally intensive part of the analysis is generating and reducing Monte Carlo realizations of an experiment's data. In this work we take the current state-of-the-art simulation and mapping software and investigate its performance when pushed to tens of thousands of cores on a range of leading HPC systems, in particular focusing on the communication bottleneck that emerges at high concurrencies. We present a new communication strategy that removes this bottleneck, allowing for CMB analyses of unprecedented scale and hence fidelity. Experimental results show a communication speedup of up to 116x using our alternative strategy.",
author = "Rajesh Sudarsan and Julian Borrill and Christopher Cantalupo and Theodore Kisner and Kamesh Madduri and Leonid Oliker and Yili Zheng and Horst Simon",
year = "2011",
month = "6",
day = "30",
doi = "10.1145/1995896.1995944",
language = "English (US)",
isbn = "9781450301022",
series = "Proceedings of the International Conference on Supercomputing",
pages = "305--316",
booktitle = "ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing",

}

Sudarsan, R, Borrill, J, Cantalupo, C, Kisner, T, Madduri, K, Oliker, L, Zheng, Y & Simon, H 2011, Cosmic microwave background map-making at the petascale and beyond. in ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing. Proceedings of the International Conference on Supercomputing, pp. 305-316, 25th ACM International Conference on Supercomputing, ICS 2011, Tucson, AZ, United States, 5/31/11. https://doi.org/10.1145/1995896.1995944

Cosmic microwave background map-making at the petascale and beyond. / Sudarsan, Rajesh; Borrill, Julian; Cantalupo, Christopher; Kisner, Theodore; Madduri, Kamesh; Oliker, Leonid; Zheng, Yili; Simon, Horst.

ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing. 2011. p. 305-316 (Proceedings of the International Conference on Supercomputing).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Cosmic microwave background map-making at the petascale and beyond

AU - Sudarsan, Rajesh

AU - Borrill, Julian

AU - Cantalupo, Christopher

AU - Kisner, Theodore

AU - Madduri, Kamesh

AU - Oliker, Leonid

AU - Zheng, Yili

AU - Simon, Horst

PY - 2011/6/30

Y1 - 2011/6/30

N2 - The analysis of Cosmic Microwave Background (CMB) observations is a long-standing computational challenge, driven by the exponential growth in the size of the data sets being gathered. Since this growth is projected to continue for at least the next decade, it will be critical to extend the analysis algorithms and their implementations to peta-scale high performance computing (HPC) systems and beyond. The most computationally intensive part of the analysis is generating and reducing Monte Carlo realizations of an experiment's data. In this work we take the current state-of-the-art simulation and mapping software and investigate its performance when pushed to tens of thousands of cores on a range of leading HPC systems, in particular focusing on the communication bottleneck that emerges at high concurrencies. We present a new communication strategy that removes this bottleneck, allowing for CMB analyses of unprecedented scale and hence fidelity. Experimental results show a communication speedup of up to 116x using our alternative strategy.

AB - The analysis of Cosmic Microwave Background (CMB) observations is a long-standing computational challenge, driven by the exponential growth in the size of the data sets being gathered. Since this growth is projected to continue for at least the next decade, it will be critical to extend the analysis algorithms and their implementations to peta-scale high performance computing (HPC) systems and beyond. The most computationally intensive part of the analysis is generating and reducing Monte Carlo realizations of an experiment's data. In this work we take the current state-of-the-art simulation and mapping software and investigate its performance when pushed to tens of thousands of cores on a range of leading HPC systems, in particular focusing on the communication bottleneck that emerges at high concurrencies. We present a new communication strategy that removes this bottleneck, allowing for CMB analyses of unprecedented scale and hence fidelity. Experimental results show a communication speedup of up to 116x using our alternative strategy.

UR - http://www.scopus.com/inward/record.url?scp=79959621920&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79959621920&partnerID=8YFLogxK

U2 - 10.1145/1995896.1995944

DO - 10.1145/1995896.1995944

M3 - Conference contribution

AN - SCOPUS:79959621920

SN - 9781450301022

T3 - Proceedings of the International Conference on Supercomputing

SP - 305

EP - 316

BT - ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing

ER -

Sudarsan R, Borrill J, Cantalupo C, Kisner T, Madduri K, Oliker L et al. Cosmic microwave background map-making at the petascale and beyond. In ICS'11 - Proceedings of the 2011 ACM International Conference on Supercomputing. 2011. p. 305-316. (Proceedings of the International Conference on Supercomputing). https://doi.org/10.1145/1995896.1995944