How incorporating feedback mechanisms in a DSS affects DSS evaluations

Ujwal Kayande, Arnaud De Bruyn, Gary L. Lilien, Arvind Rangaswamy, Gerrit H. van Bruggen

Research output: Contribution to journalArticle

45 Citations (Scopus)

Abstract

Model-based decision support systems (DSS) improve performance in many contexts that are data-rich, uncertain, and require repetitive decisions. But such DSS are often not designed to help users understand and internalize the underlying factors driving DSS recommendations. Users then feel uncertain about DSS recommendations, leading them to possibly avoid using the system. We argue that a DSS must be designed to induce an alignment of a decision maker's mental model with the decision model embedded in the DSS. Such an alignment requires effort from the decision maker and guidance from the DSS. We experimentally evaluate two DSS design characteristics that facilitate such alignment: (i) feedback on the upside potential for performance improvement and (ii) feedback on corrective actions to improve decisions. We show that, in tandem, these two types of DSS feedback induce decision makers to align their mental models with the decision model, a process we call deep learning, whereas individually these two types of feedback have little effect on deep learning. We also show that deep learning, in turn, improves user evaluations of the DSS. We discuss how our findings could lead to DSS design improvements and better returns on DSS investments.

Original languageEnglish (US)
Pages (from-to)527-546
Number of pages20
JournalInformation Systems Research
Volume20
Issue number4
DOIs
StatePublished - Dec 2009

Fingerprint

Decision support systems
Feedback
evaluation
decision maker
decision model
Feedback mechanism
System evaluation
Systems analysis
learning
performance

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management
  • Library and Information Sciences

Cite this

Kayande, Ujwal ; De Bruyn, Arnaud ; Lilien, Gary L. ; Rangaswamy, Arvind ; van Bruggen, Gerrit H. / How incorporating feedback mechanisms in a DSS affects DSS evaluations. In: Information Systems Research. 2009 ; Vol. 20, No. 4. pp. 527-546.
@article{126da09ef0d947a38bbb38cf6012be95,
title = "How incorporating feedback mechanisms in a DSS affects DSS evaluations",
abstract = "Model-based decision support systems (DSS) improve performance in many contexts that are data-rich, uncertain, and require repetitive decisions. But such DSS are often not designed to help users understand and internalize the underlying factors driving DSS recommendations. Users then feel uncertain about DSS recommendations, leading them to possibly avoid using the system. We argue that a DSS must be designed to induce an alignment of a decision maker's mental model with the decision model embedded in the DSS. Such an alignment requires effort from the decision maker and guidance from the DSS. We experimentally evaluate two DSS design characteristics that facilitate such alignment: (i) feedback on the upside potential for performance improvement and (ii) feedback on corrective actions to improve decisions. We show that, in tandem, these two types of DSS feedback induce decision makers to align their mental models with the decision model, a process we call deep learning, whereas individually these two types of feedback have little effect on deep learning. We also show that deep learning, in turn, improves user evaluations of the DSS. We discuss how our findings could lead to DSS design improvements and better returns on DSS investments.",
author = "Ujwal Kayande and {De Bruyn}, Arnaud and Lilien, {Gary L.} and Arvind Rangaswamy and {van Bruggen}, {Gerrit H.}",
year = "2009",
month = "12",
doi = "10.1287/isre.1080.0198",
language = "English (US)",
volume = "20",
pages = "527--546",
journal = "Information Systems Research",
issn = "1047-7047",
publisher = "INFORMS Inst.for Operations Res.and the Management Sciences",
number = "4",

}

How incorporating feedback mechanisms in a DSS affects DSS evaluations. / Kayande, Ujwal; De Bruyn, Arnaud; Lilien, Gary L.; Rangaswamy, Arvind; van Bruggen, Gerrit H.

In: Information Systems Research, Vol. 20, No. 4, 12.2009, p. 527-546.

Research output: Contribution to journalArticle

TY - JOUR

T1 - How incorporating feedback mechanisms in a DSS affects DSS evaluations

AU - Kayande, Ujwal

AU - De Bruyn, Arnaud

AU - Lilien, Gary L.

AU - Rangaswamy, Arvind

AU - van Bruggen, Gerrit H.

PY - 2009/12

Y1 - 2009/12

N2 - Model-based decision support systems (DSS) improve performance in many contexts that are data-rich, uncertain, and require repetitive decisions. But such DSS are often not designed to help users understand and internalize the underlying factors driving DSS recommendations. Users then feel uncertain about DSS recommendations, leading them to possibly avoid using the system. We argue that a DSS must be designed to induce an alignment of a decision maker's mental model with the decision model embedded in the DSS. Such an alignment requires effort from the decision maker and guidance from the DSS. We experimentally evaluate two DSS design characteristics that facilitate such alignment: (i) feedback on the upside potential for performance improvement and (ii) feedback on corrective actions to improve decisions. We show that, in tandem, these two types of DSS feedback induce decision makers to align their mental models with the decision model, a process we call deep learning, whereas individually these two types of feedback have little effect on deep learning. We also show that deep learning, in turn, improves user evaluations of the DSS. We discuss how our findings could lead to DSS design improvements and better returns on DSS investments.

AB - Model-based decision support systems (DSS) improve performance in many contexts that are data-rich, uncertain, and require repetitive decisions. But such DSS are often not designed to help users understand and internalize the underlying factors driving DSS recommendations. Users then feel uncertain about DSS recommendations, leading them to possibly avoid using the system. We argue that a DSS must be designed to induce an alignment of a decision maker's mental model with the decision model embedded in the DSS. Such an alignment requires effort from the decision maker and guidance from the DSS. We experimentally evaluate two DSS design characteristics that facilitate such alignment: (i) feedback on the upside potential for performance improvement and (ii) feedback on corrective actions to improve decisions. We show that, in tandem, these two types of DSS feedback induce decision makers to align their mental models with the decision model, a process we call deep learning, whereas individually these two types of feedback have little effect on deep learning. We also show that deep learning, in turn, improves user evaluations of the DSS. We discuss how our findings could lead to DSS design improvements and better returns on DSS investments.

UR - http://www.scopus.com/inward/record.url?scp=77954295387&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954295387&partnerID=8YFLogxK

U2 - 10.1287/isre.1080.0198

DO - 10.1287/isre.1080.0198

M3 - Article

AN - SCOPUS:77954295387

VL - 20

SP - 527

EP - 546

JO - Information Systems Research

JF - Information Systems Research

SN - 1047-7047

IS - 4

ER -