Data mining to support human-machine dialogue for autonomous agents

Susan L. Epstein, Rebecca Passonneau, Tiziana Ligorio, Joshua Gordon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Next-generation autonomous agents will be expected to converse with people to achieve their mutual goals. Human-machine dialogue, however, is challenged by noisy acoustic data, and by people's preference for more natural interaction. This paper describes an ambitious project that embeds human subjects in a spoken dialogue system. It collects a rich and novel data set, including spoken dialogue, human behavior, and system features. During data collection, subjects were restricted to the same databases, action choices, and noisy automated speech recognition output as a spoken dialogue system. This paper mines that data to learn how people manage the problems that arise during dialogue under such restrictions. Two different approaches to successful, goal-directed dialogue are identified this way, from which supervised learning can predict appropriate dialogue choices. The resultant models can then be incorporated into an autonomous agent that seeks to assist its user.

Original languageEnglish (US)
Title of host publicationAgents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers
Pages132-155
Number of pages24
DOIs
StatePublished - Jan 1 2012
Event7th International Workshop on Agents and Data Mining Interaction, ADMI 2011 - Taipei, Taiwan, Province of China
Duration: May 2 2011May 6 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7103 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other7th International Workshop on Agents and Data Mining Interaction, ADMI 2011
CountryTaiwan, Province of China
CityTaipei
Period5/2/115/6/11

Fingerprint

Autonomous agents
Autonomous Agents
Data mining
Data Mining
Supervised learning
Spoken Dialogue Systems
Speech recognition
Acoustics
Human Behavior
Supervised Learning
Speech Recognition
Converse
Human
Dialogue
Restriction
Predict
Output
Interaction

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Epstein, S. L., Passonneau, R., Ligorio, T., & Gordon, J. (2012). Data mining to support human-machine dialogue for autonomous agents. In Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers (pp. 132-155). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7103 LNAI). https://doi.org/10.1007/978-3-642-27609-5_10
Epstein, Susan L. ; Passonneau, Rebecca ; Ligorio, Tiziana ; Gordon, Joshua. / Data mining to support human-machine dialogue for autonomous agents. Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers. 2012. pp. 132-155 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{f59d4938b39d439aa47fc49e8a3b01cf,
title = "Data mining to support human-machine dialogue for autonomous agents",
abstract = "Next-generation autonomous agents will be expected to converse with people to achieve their mutual goals. Human-machine dialogue, however, is challenged by noisy acoustic data, and by people's preference for more natural interaction. This paper describes an ambitious project that embeds human subjects in a spoken dialogue system. It collects a rich and novel data set, including spoken dialogue, human behavior, and system features. During data collection, subjects were restricted to the same databases, action choices, and noisy automated speech recognition output as a spoken dialogue system. This paper mines that data to learn how people manage the problems that arise during dialogue under such restrictions. Two different approaches to successful, goal-directed dialogue are identified this way, from which supervised learning can predict appropriate dialogue choices. The resultant models can then be incorporated into an autonomous agent that seeks to assist its user.",
author = "Epstein, {Susan L.} and Rebecca Passonneau and Tiziana Ligorio and Joshua Gordon",
year = "2012",
month = "1",
day = "1",
doi = "10.1007/978-3-642-27609-5_10",
language = "English (US)",
isbn = "9783642276088",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "132--155",
booktitle = "Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers",

}

Epstein, SL, Passonneau, R, Ligorio, T & Gordon, J 2012, Data mining to support human-machine dialogue for autonomous agents. in Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7103 LNAI, pp. 132-155, 7th International Workshop on Agents and Data Mining Interaction, ADMI 2011, Taipei, Taiwan, Province of China, 5/2/11. https://doi.org/10.1007/978-3-642-27609-5_10

Data mining to support human-machine dialogue for autonomous agents. / Epstein, Susan L.; Passonneau, Rebecca; Ligorio, Tiziana; Gordon, Joshua.

Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers. 2012. p. 132-155 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7103 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Data mining to support human-machine dialogue for autonomous agents

AU - Epstein, Susan L.

AU - Passonneau, Rebecca

AU - Ligorio, Tiziana

AU - Gordon, Joshua

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Next-generation autonomous agents will be expected to converse with people to achieve their mutual goals. Human-machine dialogue, however, is challenged by noisy acoustic data, and by people's preference for more natural interaction. This paper describes an ambitious project that embeds human subjects in a spoken dialogue system. It collects a rich and novel data set, including spoken dialogue, human behavior, and system features. During data collection, subjects were restricted to the same databases, action choices, and noisy automated speech recognition output as a spoken dialogue system. This paper mines that data to learn how people manage the problems that arise during dialogue under such restrictions. Two different approaches to successful, goal-directed dialogue are identified this way, from which supervised learning can predict appropriate dialogue choices. The resultant models can then be incorporated into an autonomous agent that seeks to assist its user.

AB - Next-generation autonomous agents will be expected to converse with people to achieve their mutual goals. Human-machine dialogue, however, is challenged by noisy acoustic data, and by people's preference for more natural interaction. This paper describes an ambitious project that embeds human subjects in a spoken dialogue system. It collects a rich and novel data set, including spoken dialogue, human behavior, and system features. During data collection, subjects were restricted to the same databases, action choices, and noisy automated speech recognition output as a spoken dialogue system. This paper mines that data to learn how people manage the problems that arise during dialogue under such restrictions. Two different approaches to successful, goal-directed dialogue are identified this way, from which supervised learning can predict appropriate dialogue choices. The resultant models can then be incorporated into an autonomous agent that seeks to assist its user.

UR - http://www.scopus.com/inward/record.url?scp=84255166803&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84255166803&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-27609-5_10

DO - 10.1007/978-3-642-27609-5_10

M3 - Conference contribution

AN - SCOPUS:84255166803

SN - 9783642276088

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 132

EP - 155

BT - Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers

ER -

Epstein SL, Passonneau R, Ligorio T, Gordon J. Data mining to support human-machine dialogue for autonomous agents. In Agents and Data Mining Interaction - 7th International Workshop, ADMI 2011, Revised Selected Papers. 2012. p. 132-155. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-27609-5_10