Investigating the influence of avatar facial characteristics on the social behaviors of children with autism

Elizabeth J. Carter, Jennifer Hyde, Diane L. Williams, Jessica K. Hodgins

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

Autism spectrum disorder (ASD) is characterized by unusual social communication and interaction. These traits are often targets for intervention, particularly computer-based interventions (CBIs). We examined whether interactive behaviors in children with autism could be influenced by modifying the facial characteristics of computer avatars and how behavior toward avatars compared to that toward video. Participants spoke with a therapist over a modified videoconferencing system that permitted manipulation of her appearance (i.e., using cartoon or more realistic avatars versus video) and motion (i.e., exaggerating or damping facial movements). We measured the participants' speech, gaze, and gestures. In the first study, we found that the appearance complexity of the avatar did not significantly affect any social interaction behaviors. However, the results of the second study suggest that exaggerated facial motion can improve nonverbal social behaviors, such as gaze and gesture. These findings have implications for character design in CBIs for ASD.

Original languageEnglish (US)
Title of host publicationCHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
Pages140-151
Number of pages12
ISBN (Electronic)9781450333627
DOIs
StatePublished - May 7 2016
Event34th Annual Conference on Human Factors in Computing Systems, CHI 2016 - San Jose, United States
Duration: May 7 2016May 12 2016

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Other

Other34th Annual Conference on Human Factors in Computing Systems, CHI 2016
CountryUnited States
CitySan Jose
Period5/7/165/12/16

Fingerprint

Damping
Communication

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Carter, E. J., Hyde, J., Williams, D. L., & Hodgins, J. K. (2016). Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. In CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems (pp. 140-151). (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/2858036.2858345
Carter, Elizabeth J. ; Hyde, Jennifer ; Williams, Diane L. ; Hodgins, Jessica K. / Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2016. pp. 140-151 (Conference on Human Factors in Computing Systems - Proceedings).
@inproceedings{080a8c5e88fa42d28f5f0cc34750b3e6,
title = "Investigating the influence of avatar facial characteristics on the social behaviors of children with autism",
abstract = "Autism spectrum disorder (ASD) is characterized by unusual social communication and interaction. These traits are often targets for intervention, particularly computer-based interventions (CBIs). We examined whether interactive behaviors in children with autism could be influenced by modifying the facial characteristics of computer avatars and how behavior toward avatars compared to that toward video. Participants spoke with a therapist over a modified videoconferencing system that permitted manipulation of her appearance (i.e., using cartoon or more realistic avatars versus video) and motion (i.e., exaggerating or damping facial movements). We measured the participants' speech, gaze, and gestures. In the first study, we found that the appearance complexity of the avatar did not significantly affect any social interaction behaviors. However, the results of the second study suggest that exaggerated facial motion can improve nonverbal social behaviors, such as gaze and gesture. These findings have implications for character design in CBIs for ASD.",
author = "Carter, {Elizabeth J.} and Jennifer Hyde and Williams, {Diane L.} and Hodgins, {Jessica K.}",
year = "2016",
month = "5",
day = "7",
doi = "10.1145/2858036.2858345",
language = "English (US)",
series = "Conference on Human Factors in Computing Systems - Proceedings",
publisher = "Association for Computing Machinery",
pages = "140--151",
booktitle = "CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems",

}

Carter, EJ, Hyde, J, Williams, DL & Hodgins, JK 2016, Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. in CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, pp. 140-151, 34th Annual Conference on Human Factors in Computing Systems, CHI 2016, San Jose, United States, 5/7/16. https://doi.org/10.1145/2858036.2858345

Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. / Carter, Elizabeth J.; Hyde, Jennifer; Williams, Diane L.; Hodgins, Jessica K.

CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2016. p. 140-151 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Investigating the influence of avatar facial characteristics on the social behaviors of children with autism

AU - Carter, Elizabeth J.

AU - Hyde, Jennifer

AU - Williams, Diane L.

AU - Hodgins, Jessica K.

PY - 2016/5/7

Y1 - 2016/5/7

N2 - Autism spectrum disorder (ASD) is characterized by unusual social communication and interaction. These traits are often targets for intervention, particularly computer-based interventions (CBIs). We examined whether interactive behaviors in children with autism could be influenced by modifying the facial characteristics of computer avatars and how behavior toward avatars compared to that toward video. Participants spoke with a therapist over a modified videoconferencing system that permitted manipulation of her appearance (i.e., using cartoon or more realistic avatars versus video) and motion (i.e., exaggerating or damping facial movements). We measured the participants' speech, gaze, and gestures. In the first study, we found that the appearance complexity of the avatar did not significantly affect any social interaction behaviors. However, the results of the second study suggest that exaggerated facial motion can improve nonverbal social behaviors, such as gaze and gesture. These findings have implications for character design in CBIs for ASD.

AB - Autism spectrum disorder (ASD) is characterized by unusual social communication and interaction. These traits are often targets for intervention, particularly computer-based interventions (CBIs). We examined whether interactive behaviors in children with autism could be influenced by modifying the facial characteristics of computer avatars and how behavior toward avatars compared to that toward video. Participants spoke with a therapist over a modified videoconferencing system that permitted manipulation of her appearance (i.e., using cartoon or more realistic avatars versus video) and motion (i.e., exaggerating or damping facial movements). We measured the participants' speech, gaze, and gestures. In the first study, we found that the appearance complexity of the avatar did not significantly affect any social interaction behaviors. However, the results of the second study suggest that exaggerated facial motion can improve nonverbal social behaviors, such as gaze and gesture. These findings have implications for character design in CBIs for ASD.

UR - http://www.scopus.com/inward/record.url?scp=85015012168&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015012168&partnerID=8YFLogxK

U2 - 10.1145/2858036.2858345

DO - 10.1145/2858036.2858345

M3 - Conference contribution

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 140

EP - 151

BT - CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

ER -

Carter EJ, Hyde J, Williams DL, Hodgins JK. Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. In CHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2016. p. 140-151. (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/2858036.2858345