Helping agents help their users despite imperfect speech recognition

Joshua B. Gordon, Rebecca Jane Passonneau, Susan L. Epstein

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Spoken language is an important and natural way for people to communicate with computers. Nonetheless, habitable, reliable, and efficient human-machine dialogue remains difficult to achieve. This paper describes a multi-threaded semisynchronous architecture for spoken dialogue systems. The focus here is on its utterance interpretation module. Unlike most architectures for spoken dialogue systems, this new one is designed to be robust to noisy speech recognition through earlier reliance on context, a mixture of rationales for interpretation, and fine-grained use of confidence measures. We report here on a pilot study that demonstrates its robust understanding of users' objectives, and we compare it with our earlier spoken dialogue system implemented in a traditional pipeline architecture. Substantial improvements appear at all tested levels of recognizer performance.

Original languageEnglish (US)
Title of host publicationHelp Me Help You
Subtitle of host publicationBridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report
Pages12-17
Number of pages6
StatePublished - Aug 15 2011
Event2011 AAAI Spring Symposium - Stanford, CA, United States
Duration: Mar 21 2011Mar 23 2011

Publication series

NameAAAI Spring Symposium - Technical Report
VolumeSS-11-05

Other

Other2011 AAAI Spring Symposium
CountryUnited States
CityStanford, CA
Period3/21/113/23/11

Fingerprint

Speech recognition
Pipelines

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this

Gordon, J. B., Passonneau, R. J., & Epstein, S. L. (2011). Helping agents help their users despite imperfect speech recognition. In Help Me Help You: Bridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report (pp. 12-17). (AAAI Spring Symposium - Technical Report; Vol. SS-11-05).
Gordon, Joshua B. ; Passonneau, Rebecca Jane ; Epstein, Susan L. / Helping agents help their users despite imperfect speech recognition. Help Me Help You: Bridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report. 2011. pp. 12-17 (AAAI Spring Symposium - Technical Report).
@inproceedings{6cd50e3ec7b548ea99b683e0bf5fc892,
title = "Helping agents help their users despite imperfect speech recognition",
abstract = "Spoken language is an important and natural way for people to communicate with computers. Nonetheless, habitable, reliable, and efficient human-machine dialogue remains difficult to achieve. This paper describes a multi-threaded semisynchronous architecture for spoken dialogue systems. The focus here is on its utterance interpretation module. Unlike most architectures for spoken dialogue systems, this new one is designed to be robust to noisy speech recognition through earlier reliance on context, a mixture of rationales for interpretation, and fine-grained use of confidence measures. We report here on a pilot study that demonstrates its robust understanding of users' objectives, and we compare it with our earlier spoken dialogue system implemented in a traditional pipeline architecture. Substantial improvements appear at all tested levels of recognizer performance.",
author = "Gordon, {Joshua B.} and Passonneau, {Rebecca Jane} and Epstein, {Susan L.}",
year = "2011",
month = "8",
day = "15",
language = "English (US)",
isbn = "9781577354970",
series = "AAAI Spring Symposium - Technical Report",
pages = "12--17",
booktitle = "Help Me Help You",

}

Gordon, JB, Passonneau, RJ & Epstein, SL 2011, Helping agents help their users despite imperfect speech recognition. in Help Me Help You: Bridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report. AAAI Spring Symposium - Technical Report, vol. SS-11-05, pp. 12-17, 2011 AAAI Spring Symposium, Stanford, CA, United States, 3/21/11.

Helping agents help their users despite imperfect speech recognition. / Gordon, Joshua B.; Passonneau, Rebecca Jane; Epstein, Susan L.

Help Me Help You: Bridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report. 2011. p. 12-17 (AAAI Spring Symposium - Technical Report; Vol. SS-11-05).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Helping agents help their users despite imperfect speech recognition

AU - Gordon, Joshua B.

AU - Passonneau, Rebecca Jane

AU - Epstein, Susan L.

PY - 2011/8/15

Y1 - 2011/8/15

N2 - Spoken language is an important and natural way for people to communicate with computers. Nonetheless, habitable, reliable, and efficient human-machine dialogue remains difficult to achieve. This paper describes a multi-threaded semisynchronous architecture for spoken dialogue systems. The focus here is on its utterance interpretation module. Unlike most architectures for spoken dialogue systems, this new one is designed to be robust to noisy speech recognition through earlier reliance on context, a mixture of rationales for interpretation, and fine-grained use of confidence measures. We report here on a pilot study that demonstrates its robust understanding of users' objectives, and we compare it with our earlier spoken dialogue system implemented in a traditional pipeline architecture. Substantial improvements appear at all tested levels of recognizer performance.

AB - Spoken language is an important and natural way for people to communicate with computers. Nonetheless, habitable, reliable, and efficient human-machine dialogue remains difficult to achieve. This paper describes a multi-threaded semisynchronous architecture for spoken dialogue systems. The focus here is on its utterance interpretation module. Unlike most architectures for spoken dialogue systems, this new one is designed to be robust to noisy speech recognition through earlier reliance on context, a mixture of rationales for interpretation, and fine-grained use of confidence measures. We report here on a pilot study that demonstrates its robust understanding of users' objectives, and we compare it with our earlier spoken dialogue system implemented in a traditional pipeline architecture. Substantial improvements appear at all tested levels of recognizer performance.

UR - http://www.scopus.com/inward/record.url?scp=80051510557&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051510557&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:80051510557

SN - 9781577354970

T3 - AAAI Spring Symposium - Technical Report

SP - 12

EP - 17

BT - Help Me Help You

ER -

Gordon JB, Passonneau RJ, Epstein SL. Helping agents help their users despite imperfect speech recognition. In Help Me Help You: Bridging the Gaps in Human-Agent Collaboration - Papers from the AAAI Spring Symposium, Technical Report. 2011. p. 12-17. (AAAI Spring Symposium - Technical Report).