Credibility Evaluation of Project Duration Forecast Using Forecast Sensitivity and Forecast-Risk Compatibility

Byung-cheol Kim, Seong Jin Kim

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

This paper presents a credibility evaluation framework (CEF) that analytically evaluates deterministic project duration forecasts to detect false early warnings and misleading trends. The CEF consists of forecast sensitivity evaluation, forecast-risk compatibility check, and independent sanity checks using probabilistic models. New concepts of the forecast sensitivity index and threshold are defined and used to establish an unrealistically sensitive prediction zone as a graphical tool for quick and quantitative credibility evaluation. The forecast-risk compatibility check assesses the consistency of schedule variability predicted by deterministic forecasts and by standard risk assessment techniques. A hierarchical decision structure based on the compatibility check is also presented. Practical implementation and effectiveness of the CEF are demonstrated using both a notional and a real project. The framework would positively contribute to improving the effectiveness of deterministic schedule forecasts and would be best employed at both project and program levels prior to taking interruptive and burdensome control actions in order to identify false warning signals.

Original languageEnglish (US)
Article number04015023
JournalJournal of Construction Engineering and Management
Volume141
Issue number8
DOIs
StatePublished - Aug 1 2015

Fingerprint

Risk assessment
Evaluation
Credibility
Compatibility
Statistical Models
Schedule
Prediction
Forecast evaluation
Warning
Probabilistic model
Early warning

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Building and Construction
  • Industrial relations
  • Strategy and Management

Cite this

@article{51ddd8638ab34bb18bd99ea77497d128,
title = "Credibility Evaluation of Project Duration Forecast Using Forecast Sensitivity and Forecast-Risk Compatibility",
abstract = "This paper presents a credibility evaluation framework (CEF) that analytically evaluates deterministic project duration forecasts to detect false early warnings and misleading trends. The CEF consists of forecast sensitivity evaluation, forecast-risk compatibility check, and independent sanity checks using probabilistic models. New concepts of the forecast sensitivity index and threshold are defined and used to establish an unrealistically sensitive prediction zone as a graphical tool for quick and quantitative credibility evaluation. The forecast-risk compatibility check assesses the consistency of schedule variability predicted by deterministic forecasts and by standard risk assessment techniques. A hierarchical decision structure based on the compatibility check is also presented. Practical implementation and effectiveness of the CEF are demonstrated using both a notional and a real project. The framework would positively contribute to improving the effectiveness of deterministic schedule forecasts and would be best employed at both project and program levels prior to taking interruptive and burdensome control actions in order to identify false warning signals.",
author = "Byung-cheol Kim and Kim, {Seong Jin}",
year = "2015",
month = "8",
day = "1",
doi = "10.1061/(ASCE)CO.1943-7862.0001000",
language = "English (US)",
volume = "141",
journal = "Journal of Construction Engineering and Management - ASCE",
issn = "0733-9364",
publisher = "American Society of Civil Engineers (ASCE)",
number = "8",

}

TY - JOUR

T1 - Credibility Evaluation of Project Duration Forecast Using Forecast Sensitivity and Forecast-Risk Compatibility

AU - Kim, Byung-cheol

AU - Kim, Seong Jin

PY - 2015/8/1

Y1 - 2015/8/1

N2 - This paper presents a credibility evaluation framework (CEF) that analytically evaluates deterministic project duration forecasts to detect false early warnings and misleading trends. The CEF consists of forecast sensitivity evaluation, forecast-risk compatibility check, and independent sanity checks using probabilistic models. New concepts of the forecast sensitivity index and threshold are defined and used to establish an unrealistically sensitive prediction zone as a graphical tool for quick and quantitative credibility evaluation. The forecast-risk compatibility check assesses the consistency of schedule variability predicted by deterministic forecasts and by standard risk assessment techniques. A hierarchical decision structure based on the compatibility check is also presented. Practical implementation and effectiveness of the CEF are demonstrated using both a notional and a real project. The framework would positively contribute to improving the effectiveness of deterministic schedule forecasts and would be best employed at both project and program levels prior to taking interruptive and burdensome control actions in order to identify false warning signals.

AB - This paper presents a credibility evaluation framework (CEF) that analytically evaluates deterministic project duration forecasts to detect false early warnings and misleading trends. The CEF consists of forecast sensitivity evaluation, forecast-risk compatibility check, and independent sanity checks using probabilistic models. New concepts of the forecast sensitivity index and threshold are defined and used to establish an unrealistically sensitive prediction zone as a graphical tool for quick and quantitative credibility evaluation. The forecast-risk compatibility check assesses the consistency of schedule variability predicted by deterministic forecasts and by standard risk assessment techniques. A hierarchical decision structure based on the compatibility check is also presented. Practical implementation and effectiveness of the CEF are demonstrated using both a notional and a real project. The framework would positively contribute to improving the effectiveness of deterministic schedule forecasts and would be best employed at both project and program levels prior to taking interruptive and burdensome control actions in order to identify false warning signals.

UR - http://www.scopus.com/inward/record.url?scp=84951770463&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84951770463&partnerID=8YFLogxK

U2 - 10.1061/(ASCE)CO.1943-7862.0001000

DO - 10.1061/(ASCE)CO.1943-7862.0001000

M3 - Article

AN - SCOPUS:84951770463

VL - 141

JO - Journal of Construction Engineering and Management - ASCE

JF - Journal of Construction Engineering and Management - ASCE

SN - 0733-9364

IS - 8

M1 - 04015023

ER -