Show me how to win: A robot that uses dialog management to learn from demonstrations

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present an approach for robot learning from demonstration and communication applied to simple board games like Connect Four. In such games, a visual representation of a winning condition on the board can be converted to an extensive form representation that can then support computation of a winning strategy. We present a robot that can learn simple games from responses to visual questions based on synthesized images, or to verbal questions. We illustrate how reliance on both modalities leads to more efficient learning.

Original languageEnglish (US)
Title of host publicationProceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019
EditorsFoaad Khosmood, Johanna Pirker, Thomas Apperley, Sebastian Deterding
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450372176
DOIs
StatePublished - Aug 26 2019
Event14th International Conference on the Foundations of Digital Games, FDG 2019 - San Luis Obispo, United States
Duration: Aug 26 2019Aug 30 2019

Publication series

NameACM International Conference Proceeding Series

Conference

Conference14th International Conference on the Foundations of Digital Games, FDG 2019
CountryUnited States
CitySan Luis Obispo
Period8/26/198/30/19

Fingerprint

Robot learning
Demonstrations
Robots
Communication

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Zare, M., Ayub, A., Wagner, A. R., & Passonneau, R. J. (2019). Show me how to win: A robot that uses dialog management to learn from demonstrations. In F. Khosmood, J. Pirker, T. Apperley, & S. Deterding (Eds.), Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019 [78] (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3337722.3341866
Zare, Maryam ; Ayub, Ali ; Wagner, Alan Richard ; Passonneau, Rebecca Jane. / Show me how to win : A robot that uses dialog management to learn from demonstrations. Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019. editor / Foaad Khosmood ; Johanna Pirker ; Thomas Apperley ; Sebastian Deterding. Association for Computing Machinery, 2019. (ACM International Conference Proceeding Series).
@inproceedings{e5397011af4245dfaa853d43bfb75080,
title = "Show me how to win: A robot that uses dialog management to learn from demonstrations",
abstract = "We present an approach for robot learning from demonstration and communication applied to simple board games like Connect Four. In such games, a visual representation of a winning condition on the board can be converted to an extensive form representation that can then support computation of a winning strategy. We present a robot that can learn simple games from responses to visual questions based on synthesized images, or to verbal questions. We illustrate how reliance on both modalities leads to more efficient learning.",
author = "Maryam Zare and Ali Ayub and Wagner, {Alan Richard} and Passonneau, {Rebecca Jane}",
year = "2019",
month = "8",
day = "26",
doi = "10.1145/3337722.3341866",
language = "English (US)",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
editor = "Foaad Khosmood and Johanna Pirker and Thomas Apperley and Sebastian Deterding",
booktitle = "Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019",

}

Zare, M, Ayub, A, Wagner, AR & Passonneau, RJ 2019, Show me how to win: A robot that uses dialog management to learn from demonstrations. in F Khosmood, J Pirker, T Apperley & S Deterding (eds), Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019., 78, ACM International Conference Proceeding Series, Association for Computing Machinery, 14th International Conference on the Foundations of Digital Games, FDG 2019, San Luis Obispo, United States, 8/26/19. https://doi.org/10.1145/3337722.3341866

Show me how to win : A robot that uses dialog management to learn from demonstrations. / Zare, Maryam; Ayub, Ali; Wagner, Alan Richard; Passonneau, Rebecca Jane.

Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019. ed. / Foaad Khosmood; Johanna Pirker; Thomas Apperley; Sebastian Deterding. Association for Computing Machinery, 2019. 78 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Show me how to win

T2 - A robot that uses dialog management to learn from demonstrations

AU - Zare, Maryam

AU - Ayub, Ali

AU - Wagner, Alan Richard

AU - Passonneau, Rebecca Jane

PY - 2019/8/26

Y1 - 2019/8/26

N2 - We present an approach for robot learning from demonstration and communication applied to simple board games like Connect Four. In such games, a visual representation of a winning condition on the board can be converted to an extensive form representation that can then support computation of a winning strategy. We present a robot that can learn simple games from responses to visual questions based on synthesized images, or to verbal questions. We illustrate how reliance on both modalities leads to more efficient learning.

AB - We present an approach for robot learning from demonstration and communication applied to simple board games like Connect Four. In such games, a visual representation of a winning condition on the board can be converted to an extensive form representation that can then support computation of a winning strategy. We present a robot that can learn simple games from responses to visual questions based on synthesized images, or to verbal questions. We illustrate how reliance on both modalities leads to more efficient learning.

UR - http://www.scopus.com/inward/record.url?scp=85072835770&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072835770&partnerID=8YFLogxK

U2 - 10.1145/3337722.3341866

DO - 10.1145/3337722.3341866

M3 - Conference contribution

AN - SCOPUS:85072835770

T3 - ACM International Conference Proceeding Series

BT - Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019

A2 - Khosmood, Foaad

A2 - Pirker, Johanna

A2 - Apperley, Thomas

A2 - Deterding, Sebastian

PB - Association for Computing Machinery

ER -

Zare M, Ayub A, Wagner AR, Passonneau RJ. Show me how to win: A robot that uses dialog management to learn from demonstrations. In Khosmood F, Pirker J, Apperley T, Deterding S, editors, Proceedings of the 14th International Conference on the Foundations of Digital Games, FDG 2019. Association for Computing Machinery. 2019. 78. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3337722.3341866