Measuring the fit between human judgments and automated alerting algorithms: A study of collision detection

Ann M. Bisantz, Amy Pritchett

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

Methodologies for assessing human judgment in complex domains are important for the design of both displays that inform judgment and automated systems that suggest judgments. This paper uses the n-system lens model to evaluate the impact of displays on human judgment and to explicitly assess the similarity between human judgments and a set of potential judgment algorithms for use in automated systems. First, the need for and concepts underlying judgment analysis are outlined. Then the n-system lens model and its parameters are formally described. This model is then used to examine a previously conducted study of aircraft collision detection that had been analyzed using standard analysis of variance methods. Our analysis found the same main effects as did the earlier analysis. However, n-system lens model analysis was able to provide greater insight into the information relied upon for judgments and the impact of displays on judgment. Additionally, the analysis was able to identify attributes of human judgments that were - and were not - similar to judgments produced by automated systems. Potential applications of this research include automated aid design and operator training.

Original languageEnglish (US)
Pages (from-to)266-280
Number of pages15
JournalHuman Factors
Volume45
Issue number2
DOIs
StatePublished - Jun 1 2003

Fingerprint

system model
Lenses
Display devices
Design aids
model analysis
systems analysis
Analysis of variance (ANOVA)
analysis of variance
aircraft
Aircraft
methodology
Analysis of Variance
Research

All Science Journal Classification (ASJC) codes

  • Human Factors and Ergonomics
  • Applied Psychology
  • Behavioral Neuroscience

Cite this

@article{1e5f0ab0e4704868afbab7d71d1fdb0b,
title = "Measuring the fit between human judgments and automated alerting algorithms: A study of collision detection",
abstract = "Methodologies for assessing human judgment in complex domains are important for the design of both displays that inform judgment and automated systems that suggest judgments. This paper uses the n-system lens model to evaluate the impact of displays on human judgment and to explicitly assess the similarity between human judgments and a set of potential judgment algorithms for use in automated systems. First, the need for and concepts underlying judgment analysis are outlined. Then the n-system lens model and its parameters are formally described. This model is then used to examine a previously conducted study of aircraft collision detection that had been analyzed using standard analysis of variance methods. Our analysis found the same main effects as did the earlier analysis. However, n-system lens model analysis was able to provide greater insight into the information relied upon for judgments and the impact of displays on judgment. Additionally, the analysis was able to identify attributes of human judgments that were - and were not - similar to judgments produced by automated systems. Potential applications of this research include automated aid design and operator training.",
author = "Bisantz, {Ann M.} and Amy Pritchett",
year = "2003",
month = "6",
day = "1",
doi = "10.1518/hfes.45.2.266.27243",
language = "English (US)",
volume = "45",
pages = "266--280",
journal = "Human Factors",
issn = "0018-7208",
publisher = "SAGE Publications Inc.",
number = "2",

}

Measuring the fit between human judgments and automated alerting algorithms : A study of collision detection. / Bisantz, Ann M.; Pritchett, Amy.

In: Human Factors, Vol. 45, No. 2, 01.06.2003, p. 266-280.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Measuring the fit between human judgments and automated alerting algorithms

T2 - A study of collision detection

AU - Bisantz, Ann M.

AU - Pritchett, Amy

PY - 2003/6/1

Y1 - 2003/6/1

N2 - Methodologies for assessing human judgment in complex domains are important for the design of both displays that inform judgment and automated systems that suggest judgments. This paper uses the n-system lens model to evaluate the impact of displays on human judgment and to explicitly assess the similarity between human judgments and a set of potential judgment algorithms for use in automated systems. First, the need for and concepts underlying judgment analysis are outlined. Then the n-system lens model and its parameters are formally described. This model is then used to examine a previously conducted study of aircraft collision detection that had been analyzed using standard analysis of variance methods. Our analysis found the same main effects as did the earlier analysis. However, n-system lens model analysis was able to provide greater insight into the information relied upon for judgments and the impact of displays on judgment. Additionally, the analysis was able to identify attributes of human judgments that were - and were not - similar to judgments produced by automated systems. Potential applications of this research include automated aid design and operator training.

AB - Methodologies for assessing human judgment in complex domains are important for the design of both displays that inform judgment and automated systems that suggest judgments. This paper uses the n-system lens model to evaluate the impact of displays on human judgment and to explicitly assess the similarity between human judgments and a set of potential judgment algorithms for use in automated systems. First, the need for and concepts underlying judgment analysis are outlined. Then the n-system lens model and its parameters are formally described. This model is then used to examine a previously conducted study of aircraft collision detection that had been analyzed using standard analysis of variance methods. Our analysis found the same main effects as did the earlier analysis. However, n-system lens model analysis was able to provide greater insight into the information relied upon for judgments and the impact of displays on judgment. Additionally, the analysis was able to identify attributes of human judgments that were - and were not - similar to judgments produced by automated systems. Potential applications of this research include automated aid design and operator training.

UR - http://www.scopus.com/inward/record.url?scp=0041733792&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0041733792&partnerID=8YFLogxK

U2 - 10.1518/hfes.45.2.266.27243

DO - 10.1518/hfes.45.2.266.27243

M3 - Article

C2 - 14529198

AN - SCOPUS:0041733792

VL - 45

SP - 266

EP - 280

JO - Human Factors

JF - Human Factors

SN - 0018-7208

IS - 2

ER -