Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations

Jason C. York, Jeremy Michael Gernand

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The potential benefits of a safety program are generally, only realized after an incident has occurred. Resource allocation in an organization's safety program has the imperative task of balancing costs and often unrealized benefits. Management can be wary to allocate additional resources to a safety program because it is difficult to estimate the return on investment, especially since the returns are a set of negative outcomes not manifested. One way that safety professionals can provide an estimate of potential return on investment is to forecast how the organizations incident rate can be affected by implementing the different resource allocation strategies, and what the expectation for the incident rate would have been without intervention. Safety professionals often trend the performance of their organization's safety program by benchmarking incident rates against other organizations. Previous studies have employed different statistical forecasting methods to predict how incident rates will react to changes in resource allocation. This paper analyzes the performance of four statistical forecasting methods employed in previous resource allocation studies along another statistical forecasting method, never before used for incident rate prediction, to ascertain the method that provides the highest level of forecast accuracy. By identifying the most accurate forecasting method, the uncertainty of which method a safety professional should utilize for incident rate prediction is reduced. Incident data from the Mine Safety and Health Administration (MSHA) Part 50, was used to forecast both short and long term incident rates. The performance of each of these forecasting methods were evaluated against one another to determine which method has the highest level of accuracy, lowest bias, and best complexityadjusted goodness-of-fit metrics. Evaluation of the performance provides indications that the double exponential smoothing statistical forecasting method can provide the most accurate incident rate predictions. Analysis of forecast bias indicated that the error for the double exponential smoothing method is unbiased, within the acceptable range for tracking signal, and had a level of prediction accuracy above 70%. The results of this observational study indicate that the double exponential smoothing method should be the method to consider for incident rate prediction. Consistent use of the same forecasting methodology amongst safety professionals as part of their safety program's resource allocation process, will allow for more consistent benchmarking of incident rate prediction.

Original languageEnglish (US)
Title of host publicationEmerging Technologies; Safety Engineering and Risk Analysis; Materials
Subtitle of host publicationGenetics to Structures
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791857571
DOIs
StatePublished - Jan 1 2015
EventASME 2015 International Mechanical Engineering Congress and Exposition, IMECE 2015 - Houston, United States
Duration: Nov 13 2015Nov 19 2015

Publication series

NameASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE)
Volume14-2015

Other

OtherASME 2015 International Mechanical Engineering Congress and Exposition, IMECE 2015
CountryUnited States
CityHouston
Period11/13/1511/19/15

Fingerprint

Statistical methods
Resource allocation
Benchmarking
Health

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering

Cite this

York, J. C., & Gernand, J. M. (2015). Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations. In Emerging Technologies; Safety Engineering and Risk Analysis; Materials: Genetics to Structures (ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE); Vol. 14-2015). American Society of Mechanical Engineers (ASME). https://doi.org/10.1115/IMECE2015-53138
York, Jason C. ; Gernand, Jeremy Michael. / Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations. Emerging Technologies; Safety Engineering and Risk Analysis; Materials: Genetics to Structures. American Society of Mechanical Engineers (ASME), 2015. (ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE)).
@inproceedings{a44f7804daa947389517148353127856,
title = "Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations",
abstract = "The potential benefits of a safety program are generally, only realized after an incident has occurred. Resource allocation in an organization's safety program has the imperative task of balancing costs and often unrealized benefits. Management can be wary to allocate additional resources to a safety program because it is difficult to estimate the return on investment, especially since the returns are a set of negative outcomes not manifested. One way that safety professionals can provide an estimate of potential return on investment is to forecast how the organizations incident rate can be affected by implementing the different resource allocation strategies, and what the expectation for the incident rate would have been without intervention. Safety professionals often trend the performance of their organization's safety program by benchmarking incident rates against other organizations. Previous studies have employed different statistical forecasting methods to predict how incident rates will react to changes in resource allocation. This paper analyzes the performance of four statistical forecasting methods employed in previous resource allocation studies along another statistical forecasting method, never before used for incident rate prediction, to ascertain the method that provides the highest level of forecast accuracy. By identifying the most accurate forecasting method, the uncertainty of which method a safety professional should utilize for incident rate prediction is reduced. Incident data from the Mine Safety and Health Administration (MSHA) Part 50, was used to forecast both short and long term incident rates. The performance of each of these forecasting methods were evaluated against one another to determine which method has the highest level of accuracy, lowest bias, and best complexityadjusted goodness-of-fit metrics. Evaluation of the performance provides indications that the double exponential smoothing statistical forecasting method can provide the most accurate incident rate predictions. Analysis of forecast bias indicated that the error for the double exponential smoothing method is unbiased, within the acceptable range for tracking signal, and had a level of prediction accuracy above 70{\%}. The results of this observational study indicate that the double exponential smoothing method should be the method to consider for incident rate prediction. Consistent use of the same forecasting methodology amongst safety professionals as part of their safety program's resource allocation process, will allow for more consistent benchmarking of incident rate prediction.",
author = "York, {Jason C.} and Gernand, {Jeremy Michael}",
year = "2015",
month = "1",
day = "1",
doi = "10.1115/IMECE2015-53138",
language = "English (US)",
series = "ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE)",
publisher = "American Society of Mechanical Engineers (ASME)",
booktitle = "Emerging Technologies; Safety Engineering and Risk Analysis; Materials",

}

York, JC & Gernand, JM 2015, Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations. in Emerging Technologies; Safety Engineering and Risk Analysis; Materials: Genetics to Structures. ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE), vol. 14-2015, American Society of Mechanical Engineers (ASME), ASME 2015 International Mechanical Engineering Congress and Exposition, IMECE 2015, Houston, United States, 11/13/15. https://doi.org/10.1115/IMECE2015-53138

Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations. / York, Jason C.; Gernand, Jeremy Michael.

Emerging Technologies; Safety Engineering and Risk Analysis; Materials: Genetics to Structures. American Society of Mechanical Engineers (ASME), 2015. (ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE); Vol. 14-2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations

AU - York, Jason C.

AU - Gernand, Jeremy Michael

PY - 2015/1/1

Y1 - 2015/1/1

N2 - The potential benefits of a safety program are generally, only realized after an incident has occurred. Resource allocation in an organization's safety program has the imperative task of balancing costs and often unrealized benefits. Management can be wary to allocate additional resources to a safety program because it is difficult to estimate the return on investment, especially since the returns are a set of negative outcomes not manifested. One way that safety professionals can provide an estimate of potential return on investment is to forecast how the organizations incident rate can be affected by implementing the different resource allocation strategies, and what the expectation for the incident rate would have been without intervention. Safety professionals often trend the performance of their organization's safety program by benchmarking incident rates against other organizations. Previous studies have employed different statistical forecasting methods to predict how incident rates will react to changes in resource allocation. This paper analyzes the performance of four statistical forecasting methods employed in previous resource allocation studies along another statistical forecasting method, never before used for incident rate prediction, to ascertain the method that provides the highest level of forecast accuracy. By identifying the most accurate forecasting method, the uncertainty of which method a safety professional should utilize for incident rate prediction is reduced. Incident data from the Mine Safety and Health Administration (MSHA) Part 50, was used to forecast both short and long term incident rates. The performance of each of these forecasting methods were evaluated against one another to determine which method has the highest level of accuracy, lowest bias, and best complexityadjusted goodness-of-fit metrics. Evaluation of the performance provides indications that the double exponential smoothing statistical forecasting method can provide the most accurate incident rate predictions. Analysis of forecast bias indicated that the error for the double exponential smoothing method is unbiased, within the acceptable range for tracking signal, and had a level of prediction accuracy above 70%. The results of this observational study indicate that the double exponential smoothing method should be the method to consider for incident rate prediction. Consistent use of the same forecasting methodology amongst safety professionals as part of their safety program's resource allocation process, will allow for more consistent benchmarking of incident rate prediction.

AB - The potential benefits of a safety program are generally, only realized after an incident has occurred. Resource allocation in an organization's safety program has the imperative task of balancing costs and often unrealized benefits. Management can be wary to allocate additional resources to a safety program because it is difficult to estimate the return on investment, especially since the returns are a set of negative outcomes not manifested. One way that safety professionals can provide an estimate of potential return on investment is to forecast how the organizations incident rate can be affected by implementing the different resource allocation strategies, and what the expectation for the incident rate would have been without intervention. Safety professionals often trend the performance of their organization's safety program by benchmarking incident rates against other organizations. Previous studies have employed different statistical forecasting methods to predict how incident rates will react to changes in resource allocation. This paper analyzes the performance of four statistical forecasting methods employed in previous resource allocation studies along another statistical forecasting method, never before used for incident rate prediction, to ascertain the method that provides the highest level of forecast accuracy. By identifying the most accurate forecasting method, the uncertainty of which method a safety professional should utilize for incident rate prediction is reduced. Incident data from the Mine Safety and Health Administration (MSHA) Part 50, was used to forecast both short and long term incident rates. The performance of each of these forecasting methods were evaluated against one another to determine which method has the highest level of accuracy, lowest bias, and best complexityadjusted goodness-of-fit metrics. Evaluation of the performance provides indications that the double exponential smoothing statistical forecasting method can provide the most accurate incident rate predictions. Analysis of forecast bias indicated that the error for the double exponential smoothing method is unbiased, within the acceptable range for tracking signal, and had a level of prediction accuracy above 70%. The results of this observational study indicate that the double exponential smoothing method should be the method to consider for incident rate prediction. Consistent use of the same forecasting methodology amongst safety professionals as part of their safety program's resource allocation process, will allow for more consistent benchmarking of incident rate prediction.

UR - http://www.scopus.com/inward/record.url?scp=84982952663&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84982952663&partnerID=8YFLogxK

U2 - 10.1115/IMECE2015-53138

DO - 10.1115/IMECE2015-53138

M3 - Conference contribution

AN - SCOPUS:84982952663

T3 - ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE)

BT - Emerging Technologies; Safety Engineering and Risk Analysis; Materials

PB - American Society of Mechanical Engineers (ASME)

ER -

York JC, Gernand JM. Ascertainment of the archetype statistical method for incident rate forecasting through forecast performance evaluations. In Emerging Technologies; Safety Engineering and Risk Analysis; Materials: Genetics to Structures. American Society of Mechanical Engineers (ASME). 2015. (ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE)). https://doi.org/10.1115/IMECE2015-53138