What's on "their" mind

Evaluating collaborative systems using team mental models

Vincent Mancuso, Katherine Hamilton, Eric McMillan, Rachel Tesler, Susan Mohammed, Michael McNeese

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

Original languageEnglish (US)
Title of host publicationProceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011
Pages1284-1288
Number of pages5
DOIs
StatePublished - Nov 28 2011
Event55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011 - Las Vegas, NV, United States
Duration: Sep 19 2011Sep 23 2011

Publication series

NameProceedings of the Human Factors and Ergonomics Society
ISSN (Print)1071-1813

Other

Other55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011
CountryUnited States
CityLas Vegas, NV
Period9/19/119/23/11

Fingerprint

rating
Human computer interaction
evaluation
expert
simulation
methodology

All Science Journal Classification (ASJC) codes

  • Human Factors and Ergonomics

Cite this

Mancuso, V., Hamilton, K., McMillan, E., Tesler, R., Mohammed, S., & McNeese, M. (2011). What's on "their" mind: Evaluating collaborative systems using team mental models. In Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011 (pp. 1284-1288). (Proceedings of the Human Factors and Ergonomics Society). https://doi.org/10.1177/1071181311551267
Mancuso, Vincent ; Hamilton, Katherine ; McMillan, Eric ; Tesler, Rachel ; Mohammed, Susan ; McNeese, Michael. / What's on "their" mind : Evaluating collaborative systems using team mental models. Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. 2011. pp. 1284-1288 (Proceedings of the Human Factors and Ergonomics Society).
@inproceedings{62e41b704d6540519a4b0a900d8d0c1b,
title = "What's on {"}their{"} mind: Evaluating collaborative systems using team mental models",
abstract = "In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.",
author = "Vincent Mancuso and Katherine Hamilton and Eric McMillan and Rachel Tesler and Susan Mohammed and Michael McNeese",
year = "2011",
month = "11",
day = "28",
doi = "10.1177/1071181311551267",
language = "English (US)",
isbn = "9780945289395",
series = "Proceedings of the Human Factors and Ergonomics Society",
pages = "1284--1288",
booktitle = "Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011",

}

Mancuso, V, Hamilton, K, McMillan, E, Tesler, R, Mohammed, S & McNeese, M 2011, What's on "their" mind: Evaluating collaborative systems using team mental models. in Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. Proceedings of the Human Factors and Ergonomics Society, pp. 1284-1288, 55th Human Factors and Ergonomics Society Annual Meeting, HFES 2011, Las Vegas, NV, United States, 9/19/11. https://doi.org/10.1177/1071181311551267

What's on "their" mind : Evaluating collaborative systems using team mental models. / Mancuso, Vincent; Hamilton, Katherine; McMillan, Eric; Tesler, Rachel; Mohammed, Susan; McNeese, Michael.

Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. 2011. p. 1284-1288 (Proceedings of the Human Factors and Ergonomics Society).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - What's on "their" mind

T2 - Evaluating collaborative systems using team mental models

AU - Mancuso, Vincent

AU - Hamilton, Katherine

AU - McMillan, Eric

AU - Tesler, Rachel

AU - Mohammed, Susan

AU - McNeese, Michael

PY - 2011/11/28

Y1 - 2011/11/28

N2 - In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

AB - In this paper we describe a methodology for utilizing team mental models as a basis for evaluating the usa-bility and utility of collaborative systems. We present a case study of the evaluation of team mental models within the NeoCITIES 3.1 simulation. Paired comparison ratings, which are one of the most popularly used methods of team mental model assessment, were used to capture the team members' taskwork-related knowledge, which was then compared to ratings from subject matter experts. These analyses were the driv-ing force behind several design modifications in the NeoCITIES interface. We discuss the limitations of the method and its implications within the scope of collaborative systems evaluation and the field of HCI.

UR - http://www.scopus.com/inward/record.url?scp=81855161423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81855161423&partnerID=8YFLogxK

U2 - 10.1177/1071181311551267

DO - 10.1177/1071181311551267

M3 - Conference contribution

SN - 9780945289395

T3 - Proceedings of the Human Factors and Ergonomics Society

SP - 1284

EP - 1288

BT - Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011

ER -

Mancuso V, Hamilton K, McMillan E, Tesler R, Mohammed S, McNeese M. What's on "their" mind: Evaluating collaborative systems using team mental models. In Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting, HFES 2011. 2011. p. 1284-1288. (Proceedings of the Human Factors and Ergonomics Society). https://doi.org/10.1177/1071181311551267