Help me understand you: Addressing the speech recognition bottleneck

Rebecca Jane Passonneau, Susan L. Epstein, Joshua B. Gordon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

This paper focuses on the ways dialog systems might learn better strategies to handle automatic speech recognition errors from the way people handle such errors. In the well-known Wizard of Oz paradigm to study human-computer interaction, a user participates in dialog with what she believes to be a machine, but is actually another person, the wizard. The Loqui project ablates its wizards, removing human capabilities one at a time. This paper details a pilot experiment to develop specifications for Loqui's wizard ablation studies. In the pilot task, a speaker requests books in a library application. The key finding here is that, when bolstered by a very large database of titles, humans are remarkably successful at interpreting poorly recognized output. Their repertoire of clever, domain-independent methods depends upon partial matches, string length, word order, phonetic similarity, and semantics. The long term goals of this work are to provide dialog systems with new ways to ask users for help, and to provide users with greater understanding of system functionality. Once implemented, these methods should substantially reduce human frustration with automated dialog systems, and improve task success.

Original languageEnglish (US)
Title of host publicationAgents that Learn from Human Teachers - Papers from the AAAI Spring Symposium
Pages119-126
Number of pages8
StatePublished - Nov 4 2009
EventAgents that Learn from Human Teachers - Papers from the AAAI Spring Symposium - Stanford, CA, United States
Duration: Mar 23 2009Mar 25 2009

Publication series

NameAAAI Spring Symposium - Technical Report
VolumeSS-09-01

Other

OtherAgents that Learn from Human Teachers - Papers from the AAAI Spring Symposium
CountryUnited States
CityStanford, CA
Period3/23/093/25/09

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Help me understand you: Addressing the speech recognition bottleneck'. Together they form a unique fingerprint.

  • Cite this

    Passonneau, R. J., Epstein, S. L., & Gordon, J. B. (2009). Help me understand you: Addressing the speech recognition bottleneck. In Agents that Learn from Human Teachers - Papers from the AAAI Spring Symposium (pp. 119-126). (AAAI Spring Symposium - Technical Report; Vol. SS-09-01).