A game-based experimental protocol for identifying and overcoming judgment biases in forensic decision analysis

Donald R. Kretz, B. J. Simpson, Colonel Jacob Graham

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

In the aftermath of several recent catastrophic intelligence failures, the U.S. Government commissioned a series of studies to evaluate analytic methods and tradecraft. Those reports made specific recommendations to address consistent and systematic errors known as judgment biases found in all forms of analysis: predictive, estimative, and forensic. To correct for bias, a small number of methodological improvements have been suggested. There is, however, little experimental evidence to validate their impact on analytic quality. This lack of support motivates our present work, which seeks significant improvements in analytic performance by identifying common biases that emerge during analytic tasks, as well as measuring the effects of corresponding corrective measures (a.k.a.. "debiasing" techniques), which we refer to as analytic multipliers. This effort requires an experimental protocol suitable for studying the effects of many types of biases and debiasing techniques on realistic analytic problems. This paper presents our game-based paradigm for studying decision biases and developing analytic multipliers, and includes a description and results of a pilot game we developed to validate the approach.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Technologies for Homeland Security, HST 2012
Pages439-444
Number of pages6
DOIs
StatePublished - Dec 1 2012
Event2012 12th IEEE International Conference on Technologies for Homeland Security, HST 2012 - Waltham, MA, United States
Duration: Nov 13 2012Nov 15 2012

Publication series

Name2012 IEEE International Conference on Technologies for Homeland Security, HST 2012

Other

Other2012 12th IEEE International Conference on Technologies for Homeland Security, HST 2012
CountryUnited States
CityWaltham, MA
Period11/13/1211/15/12

All Science Journal Classification (ASJC) codes

  • Law

Fingerprint Dive into the research topics of 'A game-based experimental protocol for identifying and overcoming judgment biases in forensic decision analysis'. Together they form a unique fingerprint.

  • Cite this

    Kretz, D. R., Simpson, B. J., & Graham, C. J. (2012). A game-based experimental protocol for identifying and overcoming judgment biases in forensic decision analysis. In 2012 IEEE International Conference on Technologies for Homeland Security, HST 2012 (pp. 439-444). [6459889] (2012 IEEE International Conference on Technologies for Homeland Security, HST 2012). https://doi.org/10.1109/THS.2012.6459889