Stochastic control in a Bayesian framework for structural state assessment and decision making

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To address effectively the urgent societal need for safe structures and infrastructure systems under limited resources, science-based management of assets is needed. The objective of this study is to develop an optimum life-cycle cost policy that suggests inspection/monitoring and maintenance actions based on the structural conditions in real time. Markov Decision Processes (MDPs) have a successful history of implementation in asset management of engineering structures. MDPs are controlled stochastic processes that advice the decision-makers to take optimum sequential decisions based on the actual results of the inspections or the nondestructive testings they perform. The focus in this paper is on Partially Observable Markov Decision Processes (POMDPs) where observations do not reveal the true state of the system with certainty. A specific example is presented, concerning corrosion of reinforcing bars in concrete structures, and a non-stationary POMDP, for an infinite horizon case, with 332 states is cast. Modeling and solving the decision-making framework is explained and the suggested method is compared with simpler techniques to verify its theoretical and practical supremacy.

Original languageEnglish (US)
Title of host publicationSafety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013
Pages3903-3910
Number of pages8
StatePublished - Dec 1 2013
Event11th International Conference on Structural Safety and Reliability, ICOSSAR 2013 - New York, NY, United States
Duration: Jun 16 2013Jun 20 2013

Other

Other11th International Conference on Structural Safety and Reliability, ICOSSAR 2013
CountryUnited States
CityNew York, NY
Period6/16/136/20/13

Fingerprint

Inspection
Decision making
Asset management
Nondestructive examination
Random processes
Concrete construction
Life cycle
Corrosion
Monitoring
Costs

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Safety, Risk, Reliability and Quality

Cite this

Papakonstantinou, K., & Shinozuka, M. (2013). Stochastic control in a Bayesian framework for structural state assessment and decision making. In Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013 (pp. 3903-3910)
Papakonstantinou, Konstantinos ; Shinozuka, M. / Stochastic control in a Bayesian framework for structural state assessment and decision making. Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013. 2013. pp. 3903-3910
@inproceedings{d4396ecfe5cb4fe4bd1889bbd881b0e7,
title = "Stochastic control in a Bayesian framework for structural state assessment and decision making",
abstract = "To address effectively the urgent societal need for safe structures and infrastructure systems under limited resources, science-based management of assets is needed. The objective of this study is to develop an optimum life-cycle cost policy that suggests inspection/monitoring and maintenance actions based on the structural conditions in real time. Markov Decision Processes (MDPs) have a successful history of implementation in asset management of engineering structures. MDPs are controlled stochastic processes that advice the decision-makers to take optimum sequential decisions based on the actual results of the inspections or the nondestructive testings they perform. The focus in this paper is on Partially Observable Markov Decision Processes (POMDPs) where observations do not reveal the true state of the system with certainty. A specific example is presented, concerning corrosion of reinforcing bars in concrete structures, and a non-stationary POMDP, for an infinite horizon case, with 332 states is cast. Modeling and solving the decision-making framework is explained and the suggested method is compared with simpler techniques to verify its theoretical and practical supremacy.",
author = "Konstantinos Papakonstantinou and M. Shinozuka",
year = "2013",
month = "12",
day = "1",
language = "English (US)",
isbn = "9781138000865",
pages = "3903--3910",
booktitle = "Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013",

}

Papakonstantinou, K & Shinozuka, M 2013, Stochastic control in a Bayesian framework for structural state assessment and decision making. in Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013. pp. 3903-3910, 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013, New York, NY, United States, 6/16/13.

Stochastic control in a Bayesian framework for structural state assessment and decision making. / Papakonstantinou, Konstantinos; Shinozuka, M.

Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013. 2013. p. 3903-3910.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Stochastic control in a Bayesian framework for structural state assessment and decision making

AU - Papakonstantinou, Konstantinos

AU - Shinozuka, M.

PY - 2013/12/1

Y1 - 2013/12/1

N2 - To address effectively the urgent societal need for safe structures and infrastructure systems under limited resources, science-based management of assets is needed. The objective of this study is to develop an optimum life-cycle cost policy that suggests inspection/monitoring and maintenance actions based on the structural conditions in real time. Markov Decision Processes (MDPs) have a successful history of implementation in asset management of engineering structures. MDPs are controlled stochastic processes that advice the decision-makers to take optimum sequential decisions based on the actual results of the inspections or the nondestructive testings they perform. The focus in this paper is on Partially Observable Markov Decision Processes (POMDPs) where observations do not reveal the true state of the system with certainty. A specific example is presented, concerning corrosion of reinforcing bars in concrete structures, and a non-stationary POMDP, for an infinite horizon case, with 332 states is cast. Modeling and solving the decision-making framework is explained and the suggested method is compared with simpler techniques to verify its theoretical and practical supremacy.

AB - To address effectively the urgent societal need for safe structures and infrastructure systems under limited resources, science-based management of assets is needed. The objective of this study is to develop an optimum life-cycle cost policy that suggests inspection/monitoring and maintenance actions based on the structural conditions in real time. Markov Decision Processes (MDPs) have a successful history of implementation in asset management of engineering structures. MDPs are controlled stochastic processes that advice the decision-makers to take optimum sequential decisions based on the actual results of the inspections or the nondestructive testings they perform. The focus in this paper is on Partially Observable Markov Decision Processes (POMDPs) where observations do not reveal the true state of the system with certainty. A specific example is presented, concerning corrosion of reinforcing bars in concrete structures, and a non-stationary POMDP, for an infinite horizon case, with 332 states is cast. Modeling and solving the decision-making framework is explained and the suggested method is compared with simpler techniques to verify its theoretical and practical supremacy.

UR - http://www.scopus.com/inward/record.url?scp=84892409767&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892409767&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84892409767

SN - 9781138000865

SP - 3903

EP - 3910

BT - Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013

ER -

Papakonstantinou K, Shinozuka M. Stochastic control in a Bayesian framework for structural state assessment and decision making. In Safety, Reliability, Risk and Life-Cycle Performance of Structures and Infrastructures - Proceedings of the 11th International Conference on Structural Safety and Reliability, ICOSSAR 2013. 2013. p. 3903-3910