Model assessment in scientific computing Considering robustness to uncertainty in input parameters

Saurabh Prabhu, Sez Atamturktur, Scott Cogan

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Purpose - This paper aims to focus on the assessment of the ability of computer models with imperfect functional forms and uncertain input parameters to represent reality. Design/methodology/approach - In this assessment, both the agreement between a model's predictions and available experiments and the robustness of this agreement to uncertainty have been evaluated. The concept of satisfying boundaries to represent input parameter sets that yield model predictions with acceptable fidelity to observed experiments has been introduced. Findings - Satisfying boundaries provide several useful indicators for model assessment, and when calculated for varying fidelity thresholds and input parameter uncertainties, reveal the trade-off between the robustness to uncertainty in model parameters, the threshold for satisfactory fidelity and the probability of satisfying the given fidelity threshold. Using a controlled case-study example, important modeling decisions such as acceptable level of uncertainty, fidelity requirements and resource allocation for additional experiments are shown. Originality/value - Traditional methods of model assessment are solely based on fidelity to experiments, leading to a single parameter set that is considered fidelity-optimal, which essentially represents the values which yield the optimal compensation between various sources of errors and uncertainties. Rather than maximizing fidelity, this study advocates for basing model assessment on the model's ability to satisfy a required fidelity (or error tolerance). Evaluating the trade-off between error tolerance, parameter uncertainty and probability of satisfying this predefined error threshold provides us with a powerful tool for model assessment and resource allocation.

Original languageEnglish (US)
Pages (from-to)1700-1723
Number of pages24
JournalEngineering Computations (Swansea, Wales)
Volume34
Issue number5
DOIs
StatePublished - Jan 1 2017

All Science Journal Classification (ASJC) codes

  • Software
  • Engineering(all)
  • Computer Science Applications
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'Model assessment in scientific computing Considering robustness to uncertainty in input parameters'. Together they form a unique fingerprint.

Cite this