Evaluating the effect of visually represented geodata uncertainty on decision-making: systematic review, lessons learned, and recommendations

Christoph Kinkeldey, Alan M. MacEachren, Maria Riveiro, Jochen Schiewe

Research output: Contribution to journalReview article

29 Citations (Scopus)

Abstract

For many years, uncertainty visualization has been a topic of research in several disparate fields, particularly in geographical visualization (geovisualization), information visualization, and scientific visualization. Multiple techniques have been proposed and implemented to visually depict uncertainty, but their evaluation has received less attention by the research community. In order to understand how uncertainty visualization influences reasoning and decision-making using spatial information in visual displays, this paper presents a comprehensive review of uncertainty visualization assessments from geovisualization and related fields. We systematically analyze characteristics of the studies under review, i.e., number of participants, tasks, evaluation metrics, etc. An extensive summary of findings with respect to the effects measured or the impact of different visualization techniques helps to identify commonalities and differences in the outcome. Based on this summary, we derive “lessons learned” and provide recommendations for carrying out evaluation of uncertainty visualizations. As a basis for systematic evaluation, we present a categorization of research foci related to evaluating the effects of uncertainty visualization on decision-making. By assigning the studies to categories, we identify gaps in the literature and suggest key research questions for the future. This paper is the second of two reviews on uncertainty visualization. It follows the first that covers the communication of uncertainty, to investigate the effects of uncertainty visualization on reasoning and decision-making.

Original languageEnglish (US)
Pages (from-to)1-21
Number of pages21
JournalCartography and Geographic Information Science
Volume44
Issue number1
DOIs
StatePublished - Jan 2 2017

Fingerprint

visualization
Visualization
Decision making
decision making
uncertainty
evaluation
effect
recommendation
Uncertainty
Lessons learned
Systematic review
Data visualization
research focus
Display devices
communication
Evaluation
Communication

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Geography, Planning and Development
  • Management of Technology and Innovation

Cite this

@article{35daaa8d48754a3fa3a52af47f978acc,
title = "Evaluating the effect of visually represented geodata uncertainty on decision-making: systematic review, lessons learned, and recommendations",
abstract = "For many years, uncertainty visualization has been a topic of research in several disparate fields, particularly in geographical visualization (geovisualization), information visualization, and scientific visualization. Multiple techniques have been proposed and implemented to visually depict uncertainty, but their evaluation has received less attention by the research community. In order to understand how uncertainty visualization influences reasoning and decision-making using spatial information in visual displays, this paper presents a comprehensive review of uncertainty visualization assessments from geovisualization and related fields. We systematically analyze characteristics of the studies under review, i.e., number of participants, tasks, evaluation metrics, etc. An extensive summary of findings with respect to the effects measured or the impact of different visualization techniques helps to identify commonalities and differences in the outcome. Based on this summary, we derive “lessons learned” and provide recommendations for carrying out evaluation of uncertainty visualizations. As a basis for systematic evaluation, we present a categorization of research foci related to evaluating the effects of uncertainty visualization on decision-making. By assigning the studies to categories, we identify gaps in the literature and suggest key research questions for the future. This paper is the second of two reviews on uncertainty visualization. It follows the first that covers the communication of uncertainty, to investigate the effects of uncertainty visualization on reasoning and decision-making.",
author = "Christoph Kinkeldey and MacEachren, {Alan M.} and Maria Riveiro and Jochen Schiewe",
year = "2017",
month = "1",
day = "2",
doi = "10.1080/15230406.2015.1089792",
language = "English (US)",
volume = "44",
pages = "1--21",
journal = "Cartography and Geographic Information Science",
issn = "1523-0406",
publisher = "American Congress on Surveying and Mapping",
number = "1",

}

Evaluating the effect of visually represented geodata uncertainty on decision-making : systematic review, lessons learned, and recommendations. / Kinkeldey, Christoph; MacEachren, Alan M.; Riveiro, Maria; Schiewe, Jochen.

In: Cartography and Geographic Information Science, Vol. 44, No. 1, 02.01.2017, p. 1-21.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Evaluating the effect of visually represented geodata uncertainty on decision-making

T2 - systematic review, lessons learned, and recommendations

AU - Kinkeldey, Christoph

AU - MacEachren, Alan M.

AU - Riveiro, Maria

AU - Schiewe, Jochen

PY - 2017/1/2

Y1 - 2017/1/2

N2 - For many years, uncertainty visualization has been a topic of research in several disparate fields, particularly in geographical visualization (geovisualization), information visualization, and scientific visualization. Multiple techniques have been proposed and implemented to visually depict uncertainty, but their evaluation has received less attention by the research community. In order to understand how uncertainty visualization influences reasoning and decision-making using spatial information in visual displays, this paper presents a comprehensive review of uncertainty visualization assessments from geovisualization and related fields. We systematically analyze characteristics of the studies under review, i.e., number of participants, tasks, evaluation metrics, etc. An extensive summary of findings with respect to the effects measured or the impact of different visualization techniques helps to identify commonalities and differences in the outcome. Based on this summary, we derive “lessons learned” and provide recommendations for carrying out evaluation of uncertainty visualizations. As a basis for systematic evaluation, we present a categorization of research foci related to evaluating the effects of uncertainty visualization on decision-making. By assigning the studies to categories, we identify gaps in the literature and suggest key research questions for the future. This paper is the second of two reviews on uncertainty visualization. It follows the first that covers the communication of uncertainty, to investigate the effects of uncertainty visualization on reasoning and decision-making.

AB - For many years, uncertainty visualization has been a topic of research in several disparate fields, particularly in geographical visualization (geovisualization), information visualization, and scientific visualization. Multiple techniques have been proposed and implemented to visually depict uncertainty, but their evaluation has received less attention by the research community. In order to understand how uncertainty visualization influences reasoning and decision-making using spatial information in visual displays, this paper presents a comprehensive review of uncertainty visualization assessments from geovisualization and related fields. We systematically analyze characteristics of the studies under review, i.e., number of participants, tasks, evaluation metrics, etc. An extensive summary of findings with respect to the effects measured or the impact of different visualization techniques helps to identify commonalities and differences in the outcome. Based on this summary, we derive “lessons learned” and provide recommendations for carrying out evaluation of uncertainty visualizations. As a basis for systematic evaluation, we present a categorization of research foci related to evaluating the effects of uncertainty visualization on decision-making. By assigning the studies to categories, we identify gaps in the literature and suggest key research questions for the future. This paper is the second of two reviews on uncertainty visualization. It follows the first that covers the communication of uncertainty, to investigate the effects of uncertainty visualization on reasoning and decision-making.

UR - http://www.scopus.com/inward/record.url?scp=84941686201&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84941686201&partnerID=8YFLogxK

U2 - 10.1080/15230406.2015.1089792

DO - 10.1080/15230406.2015.1089792

M3 - Review article

AN - SCOPUS:84941686201

VL - 44

SP - 1

EP - 21

JO - Cartography and Geographic Information Science

JF - Cartography and Geographic Information Science

SN - 1523-0406

IS - 1

ER -