On robust and efficient parallel reservoir simulation on tianhe-2

Wenchao Guan, Changhe Qiao, Hongxuan Zhang, Chen Song Zhang, Meipeng Zhi, Zhifan Zhu, Zhenying Zheng, Weicai Ye, Yongdong Zhang, Xiaozhe Hu, Zheng Li, Chunsheng Feng, Yuesheng Xu, Jinchao Xu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Parallel reservoir simulators are now widely used with availability of super computers. Modern massively parallel supercomputers demonstrate great power for simulating large-scale reservoir models. However, improving scalability and efficiency for fully implicit methods on emerging parallel architectures is still challenging. In this paper, we present a robust discretization together with a parallel linear solver algorithm; and we explore the parallel implementation on the world's fastest supercomputer Tianhe-2. Starting with a general compositional model, we focus on the black oil model and developed Parallel eXtension Framework for parallelizing the serial simulator. A parallel preconditioner based on fast auxiliary space preconditioning (FASP) is applied to solve the Jacobian system arising from the fully implicit discretization. The parallel simulator was validated using large-scale black oil benchmark problems, for which parallel scalabilities were tested. Giant reservoir models with over 100 million grid blocks have been simulated within a few minutes, and test the strong scalability of AMG solver with 1 billion unknown. We also demonstrate the parallelization and acceleration using Intel Xeon Phi coprocessors. In the end, the efficiency of the parallel simulator is illustrated by a giant reservoir using up to 10,000 cores, for which the CPU and communication time are summarized for the linear and nonlinear algorithms.

Original languageEnglish (US)
Title of host publicationSociety of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015
PublisherSociety of Petroleum Engineers
Pages933-945
Number of pages13
ISBN (Electronic)9781510813427
StatePublished - Jan 1 2015
EventSPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015 - Abu Dhabi, United Arab Emirates
Duration: Sep 14 2015Sep 16 2015

Publication series

NameSociety of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015

Other

OtherSPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015
CountryUnited Arab Emirates
CityAbu Dhabi
Period9/14/159/16/15

Fingerprint

simulator
Simulators
Scalability
Supercomputers
simulation
Oils
Parallel architectures
oil
Program processors
Availability
communication
Communication

All Science Journal Classification (ASJC) codes

  • Geochemistry and Petrology
  • Geotechnical Engineering and Engineering Geology
  • Fuel Technology

Cite this

Guan, W., Qiao, C., Zhang, H., Zhang, C. S., Zhi, M., Zhu, Z., ... Xu, J. (2015). On robust and efficient parallel reservoir simulation on tianhe-2. In Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015 (pp. 933-945). (Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015). Society of Petroleum Engineers.
Guan, Wenchao ; Qiao, Changhe ; Zhang, Hongxuan ; Zhang, Chen Song ; Zhi, Meipeng ; Zhu, Zhifan ; Zheng, Zhenying ; Ye, Weicai ; Zhang, Yongdong ; Hu, Xiaozhe ; Li, Zheng ; Feng, Chunsheng ; Xu, Yuesheng ; Xu, Jinchao. / On robust and efficient parallel reservoir simulation on tianhe-2. Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015. Society of Petroleum Engineers, 2015. pp. 933-945 (Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015).
@inproceedings{506351ca328943918299dcc057850329,
title = "On robust and efficient parallel reservoir simulation on tianhe-2",
abstract = "Parallel reservoir simulators are now widely used with availability of super computers. Modern massively parallel supercomputers demonstrate great power for simulating large-scale reservoir models. However, improving scalability and efficiency for fully implicit methods on emerging parallel architectures is still challenging. In this paper, we present a robust discretization together with a parallel linear solver algorithm; and we explore the parallel implementation on the world's fastest supercomputer Tianhe-2. Starting with a general compositional model, we focus on the black oil model and developed Parallel eXtension Framework for parallelizing the serial simulator. A parallel preconditioner based on fast auxiliary space preconditioning (FASP) is applied to solve the Jacobian system arising from the fully implicit discretization. The parallel simulator was validated using large-scale black oil benchmark problems, for which parallel scalabilities were tested. Giant reservoir models with over 100 million grid blocks have been simulated within a few minutes, and test the strong scalability of AMG solver with 1 billion unknown. We also demonstrate the parallelization and acceleration using Intel Xeon Phi coprocessors. In the end, the efficiency of the parallel simulator is illustrated by a giant reservoir using up to 10,000 cores, for which the CPU and communication time are summarized for the linear and nonlinear algorithms.",
author = "Wenchao Guan and Changhe Qiao and Hongxuan Zhang and Zhang, {Chen Song} and Meipeng Zhi and Zhifan Zhu and Zhenying Zheng and Weicai Ye and Yongdong Zhang and Xiaozhe Hu and Zheng Li and Chunsheng Feng and Yuesheng Xu and Jinchao Xu",
year = "2015",
month = "1",
day = "1",
language = "English (US)",
series = "Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015",
publisher = "Society of Petroleum Engineers",
pages = "933--945",
booktitle = "Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015",

}

Guan, W, Qiao, C, Zhang, H, Zhang, CS, Zhi, M, Zhu, Z, Zheng, Z, Ye, W, Zhang, Y, Hu, X, Li, Z, Feng, C, Xu, Y & Xu, J 2015, On robust and efficient parallel reservoir simulation on tianhe-2. in Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015. Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015, Society of Petroleum Engineers, pp. 933-945, SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015, Abu Dhabi, United Arab Emirates, 9/14/15.

On robust and efficient parallel reservoir simulation on tianhe-2. / Guan, Wenchao; Qiao, Changhe; Zhang, Hongxuan; Zhang, Chen Song; Zhi, Meipeng; Zhu, Zhifan; Zheng, Zhenying; Ye, Weicai; Zhang, Yongdong; Hu, Xiaozhe; Li, Zheng; Feng, Chunsheng; Xu, Yuesheng; Xu, Jinchao.

Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015. Society of Petroleum Engineers, 2015. p. 933-945 (Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - On robust and efficient parallel reservoir simulation on tianhe-2

AU - Guan, Wenchao

AU - Qiao, Changhe

AU - Zhang, Hongxuan

AU - Zhang, Chen Song

AU - Zhi, Meipeng

AU - Zhu, Zhifan

AU - Zheng, Zhenying

AU - Ye, Weicai

AU - Zhang, Yongdong

AU - Hu, Xiaozhe

AU - Li, Zheng

AU - Feng, Chunsheng

AU - Xu, Yuesheng

AU - Xu, Jinchao

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Parallel reservoir simulators are now widely used with availability of super computers. Modern massively parallel supercomputers demonstrate great power for simulating large-scale reservoir models. However, improving scalability and efficiency for fully implicit methods on emerging parallel architectures is still challenging. In this paper, we present a robust discretization together with a parallel linear solver algorithm; and we explore the parallel implementation on the world's fastest supercomputer Tianhe-2. Starting with a general compositional model, we focus on the black oil model and developed Parallel eXtension Framework for parallelizing the serial simulator. A parallel preconditioner based on fast auxiliary space preconditioning (FASP) is applied to solve the Jacobian system arising from the fully implicit discretization. The parallel simulator was validated using large-scale black oil benchmark problems, for which parallel scalabilities were tested. Giant reservoir models with over 100 million grid blocks have been simulated within a few minutes, and test the strong scalability of AMG solver with 1 billion unknown. We also demonstrate the parallelization and acceleration using Intel Xeon Phi coprocessors. In the end, the efficiency of the parallel simulator is illustrated by a giant reservoir using up to 10,000 cores, for which the CPU and communication time are summarized for the linear and nonlinear algorithms.

AB - Parallel reservoir simulators are now widely used with availability of super computers. Modern massively parallel supercomputers demonstrate great power for simulating large-scale reservoir models. However, improving scalability and efficiency for fully implicit methods on emerging parallel architectures is still challenging. In this paper, we present a robust discretization together with a parallel linear solver algorithm; and we explore the parallel implementation on the world's fastest supercomputer Tianhe-2. Starting with a general compositional model, we focus on the black oil model and developed Parallel eXtension Framework for parallelizing the serial simulator. A parallel preconditioner based on fast auxiliary space preconditioning (FASP) is applied to solve the Jacobian system arising from the fully implicit discretization. The parallel simulator was validated using large-scale black oil benchmark problems, for which parallel scalabilities were tested. Giant reservoir models with over 100 million grid blocks have been simulated within a few minutes, and test the strong scalability of AMG solver with 1 billion unknown. We also demonstrate the parallelization and acceleration using Intel Xeon Phi coprocessors. In the end, the efficiency of the parallel simulator is illustrated by a giant reservoir using up to 10,000 cores, for which the CPU and communication time are summarized for the linear and nonlinear algorithms.

UR - http://www.scopus.com/inward/record.url?scp=84961191769&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961191769&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84961191769

T3 - Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015

SP - 933

EP - 945

BT - Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015

PB - Society of Petroleum Engineers

ER -

Guan W, Qiao C, Zhang H, Zhang CS, Zhi M, Zhu Z et al. On robust and efficient parallel reservoir simulation on tianhe-2. In Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015. Society of Petroleum Engineers. 2015. p. 933-945. (Society of Petroleum Engineers - SPE Reservoir Characterisation and Simulation Conference and Exhibition, RCSC 2015).