Overtrust of robots in emergency evacuation scenarios

Paul Robinette, Wenchen Li, Robert Allen, Ayanna M. Howard, Alan R. Wagner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

68 Citations (Scopus)

Abstract

Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.

Original languageEnglish (US)
Title of host publicationHRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction
PublisherIEEE Computer Society
Pages101-108
Number of pages8
ISBN (Electronic)9781467383707
DOIs
StatePublished - Apr 12 2016
Event11th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2016 - Christchurch, New Zealand
Duration: Mar 7 2016Mar 10 2016

Publication series

NameACM/IEEE International Conference on Human-Robot Interaction
Volume2016-April
ISSN (Electronic)2167-2148

Other

Other11th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2016
CountryNew Zealand
CityChristchurch
Period3/7/163/10/16

Fingerprint

Robots
Smoke
Failure modes
Fires
Navigation
Experiments

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Cite this

Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R. (2016). Overtrust of robots in emergency evacuation scenarios. In HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction (pp. 101-108). [7451740] (ACM/IEEE International Conference on Human-Robot Interaction; Vol. 2016-April). IEEE Computer Society. https://doi.org/10.1109/HRI.2016.7451740
Robinette, Paul ; Li, Wenchen ; Allen, Robert ; Howard, Ayanna M. ; Wagner, Alan R. / Overtrust of robots in emergency evacuation scenarios. HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction. IEEE Computer Society, 2016. pp. 101-108 (ACM/IEEE International Conference on Human-Robot Interaction).
@inproceedings{d4f9cb51f9394feab1190711c57b0107,
title = "Overtrust of robots in emergency evacuation scenarios",
abstract = "Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.",
author = "Paul Robinette and Wenchen Li and Robert Allen and Howard, {Ayanna M.} and Wagner, {Alan R.}",
year = "2016",
month = "4",
day = "12",
doi = "10.1109/HRI.2016.7451740",
language = "English (US)",
series = "ACM/IEEE International Conference on Human-Robot Interaction",
publisher = "IEEE Computer Society",
pages = "101--108",
booktitle = "HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction",
address = "United States",

}

Robinette, P, Li, W, Allen, R, Howard, AM & Wagner, AR 2016, Overtrust of robots in emergency evacuation scenarios. in HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction., 7451740, ACM/IEEE International Conference on Human-Robot Interaction, vol. 2016-April, IEEE Computer Society, pp. 101-108, 11th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2016, Christchurch, New Zealand, 3/7/16. https://doi.org/10.1109/HRI.2016.7451740

Overtrust of robots in emergency evacuation scenarios. / Robinette, Paul; Li, Wenchen; Allen, Robert; Howard, Ayanna M.; Wagner, Alan R.

HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction. IEEE Computer Society, 2016. p. 101-108 7451740 (ACM/IEEE International Conference on Human-Robot Interaction; Vol. 2016-April).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Overtrust of robots in emergency evacuation scenarios

AU - Robinette, Paul

AU - Li, Wenchen

AU - Allen, Robert

AU - Howard, Ayanna M.

AU - Wagner, Alan R.

PY - 2016/4/12

Y1 - 2016/4/12

N2 - Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.

AB - Robots have the potential to save lives in emergency scenarios, but could have an equally disastrous effect if participants overtrust them. To explore this concept, we performed an experiment where a participant interacts with a robot in a non-emergency task to experience its behavior and then chooses whether to follow the robot's instructions in an emergency or not. Artificial smoke and fire alarms were used to add a sense of urgency. To our surprise, all 26 participants followed the robot in the emergency, despite half observing the same robot perform poorly in a navigation guidance task just minutes before. We performed additional exploratory studies investigating different failure modes. Even when the robot pointed to a dark room with no discernible exit the majority of people did not choose to safely exit the way they entered.

UR - http://www.scopus.com/inward/record.url?scp=84964846793&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964846793&partnerID=8YFLogxK

U2 - 10.1109/HRI.2016.7451740

DO - 10.1109/HRI.2016.7451740

M3 - Conference contribution

AN - SCOPUS:84964846793

T3 - ACM/IEEE International Conference on Human-Robot Interaction

SP - 101

EP - 108

BT - HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction

PB - IEEE Computer Society

ER -

Robinette P, Li W, Allen R, Howard AM, Wagner AR. Overtrust of robots in emergency evacuation scenarios. In HRI 2016 - 11th ACM/IEEE International Conference on Human Robot Interaction. IEEE Computer Society. 2016. p. 101-108. 7451740. (ACM/IEEE International Conference on Human-Robot Interaction). https://doi.org/10.1109/HRI.2016.7451740