Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars

Steven M. Boker, Jeffrey F. Cohn, Barry John Theobald, Iain Matthews, Timothy R. Brick, Jeffrey R. Spies

Research output: Contribution to journalArticle

47 Citations (Scopus)

Abstract

When people speak with one another, they tend to adapt their head movements and facial expressions in response to each others' head movements and facial expressions. We present an experiment in which confederates' head movements and facial expressions were motion tracked during videoconference conversations, an avatar face was reconstructed in real time, and naive participants spoke with the avatar face. No naive participant guessed that the computer generated face was not video. Confederates' facial expressions, vocal inflections and head movements were attenuated at 1 min intervals in a fully crossed experimental design. Attenuated head movements led to increased head nods and lateral head turns, and attenuated facial expressions led to increased head nodding in both naive participants and confederates. Together, these results are consistent with a hypothesis that the dynamics of head movements in dyadicconversation include a shared equilibrium. Although both conversational partners were blind to the manipulation, when apparent head movement of one conversant was attenuated, both partners responded by increasing the velocity of their head movements.

Original languageEnglish (US)
Pages (from-to)3485-3495
Number of pages11
JournalPhilosophical Transactions of the Royal Society B: Biological Sciences
Volume364
Issue number1535
DOIs
StatePublished - Dec 12 2009

Fingerprint

Head Movements
Facial Expression
Design of experiments
Damping
Experiments
Head
Videoconferencing
Research Design
experimental design

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

@article{506e254d91654be3bc0d0e5d9522f8fc,
title = "Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars",
abstract = "When people speak with one another, they tend to adapt their head movements and facial expressions in response to each others' head movements and facial expressions. We present an experiment in which confederates' head movements and facial expressions were motion tracked during videoconference conversations, an avatar face was reconstructed in real time, and naive participants spoke with the avatar face. No naive participant guessed that the computer generated face was not video. Confederates' facial expressions, vocal inflections and head movements were attenuated at 1 min intervals in a fully crossed experimental design. Attenuated head movements led to increased head nods and lateral head turns, and attenuated facial expressions led to increased head nodding in both naive participants and confederates. Together, these results are consistent with a hypothesis that the dynamics of head movements in dyadicconversation include a shared equilibrium. Although both conversational partners were blind to the manipulation, when apparent head movement of one conversant was attenuated, both partners responded by increasing the velocity of their head movements.",
author = "Boker, {Steven M.} and Cohn, {Jeffrey F.} and Theobald, {Barry John} and Iain Matthews and Brick, {Timothy R.} and Spies, {Jeffrey R.}",
year = "2009",
month = "12",
day = "12",
doi = "10.1098/rstb.2009.0152",
language = "English (US)",
volume = "364",
pages = "3485--3495",
journal = "Philosophical Transactions of the Royal Society B: Biological Sciences",
issn = "0962-8436",
publisher = "Royal Society of London",
number = "1535",

}

Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars. / Boker, Steven M.; Cohn, Jeffrey F.; Theobald, Barry John; Matthews, Iain; Brick, Timothy R.; Spies, Jeffrey R.

In: Philosophical Transactions of the Royal Society B: Biological Sciences, Vol. 364, No. 1535, 12.12.2009, p. 3485-3495.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars

AU - Boker, Steven M.

AU - Cohn, Jeffrey F.

AU - Theobald, Barry John

AU - Matthews, Iain

AU - Brick, Timothy R.

AU - Spies, Jeffrey R.

PY - 2009/12/12

Y1 - 2009/12/12

N2 - When people speak with one another, they tend to adapt their head movements and facial expressions in response to each others' head movements and facial expressions. We present an experiment in which confederates' head movements and facial expressions were motion tracked during videoconference conversations, an avatar face was reconstructed in real time, and naive participants spoke with the avatar face. No naive participant guessed that the computer generated face was not video. Confederates' facial expressions, vocal inflections and head movements were attenuated at 1 min intervals in a fully crossed experimental design. Attenuated head movements led to increased head nods and lateral head turns, and attenuated facial expressions led to increased head nodding in both naive participants and confederates. Together, these results are consistent with a hypothesis that the dynamics of head movements in dyadicconversation include a shared equilibrium. Although both conversational partners were blind to the manipulation, when apparent head movement of one conversant was attenuated, both partners responded by increasing the velocity of their head movements.

AB - When people speak with one another, they tend to adapt their head movements and facial expressions in response to each others' head movements and facial expressions. We present an experiment in which confederates' head movements and facial expressions were motion tracked during videoconference conversations, an avatar face was reconstructed in real time, and naive participants spoke with the avatar face. No naive participant guessed that the computer generated face was not video. Confederates' facial expressions, vocal inflections and head movements were attenuated at 1 min intervals in a fully crossed experimental design. Attenuated head movements led to increased head nods and lateral head turns, and attenuated facial expressions led to increased head nodding in both naive participants and confederates. Together, these results are consistent with a hypothesis that the dynamics of head movements in dyadicconversation include a shared equilibrium. Although both conversational partners were blind to the manipulation, when apparent head movement of one conversant was attenuated, both partners responded by increasing the velocity of their head movements.

UR - http://www.scopus.com/inward/record.url?scp=73549097793&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=73549097793&partnerID=8YFLogxK

U2 - 10.1098/rstb.2009.0152

DO - 10.1098/rstb.2009.0152

M3 - Article

C2 - 19884143

AN - SCOPUS:73549097793

VL - 364

SP - 3485

EP - 3495

JO - Philosophical Transactions of the Royal Society B: Biological Sciences

JF - Philosophical Transactions of the Royal Society B: Biological Sciences

SN - 0962-8436

IS - 1535

ER -