TY - JOUR
T1 - Multimodal integration in statistical learning
T2 - Evidence from the McGurk illusion
AU - Mitchel, Aaron D.
AU - Christiansen, Morten H.
AU - Weiss, Daniel J.
N1 - Copyright:
Copyright 2014 Elsevier B.V., All rights reserved.
PY - 2014
Y1 - 2014
N2 - Recent advances in the field of statistical learning have established that learners are able to track regularities of multimodal stimuli, yet it is unknown whether the statistical computations are performed on integrated representations or on separate, unimodal representations. In the present study, we investigated the ability of adults to integrate audio and visual input during statistical learning. We presented learners with a speech stream synchronized with a video of a speaker's face. In the critical condition, the visual (e.g.,/gi/) and auditory (e.g.,/mi/) signals were occasionally incongruent, which we predicted would produce the McGurk illusion, resulting in the perception of an audiovisual syllable (e.g.,/ni/). In this way, we used the McGurk illusion to manipulate the underlying statistical structure of the speech streams, such that perception of these illusory syllables facilitated participants' ability to segment the speech stream. Our results therefore demonstrate that participants can integrate audio and visual input to perceive the McGurk illusion during statistical learning. We interpret our findings as support for modality-interactive accounts of statistical learning.
AB - Recent advances in the field of statistical learning have established that learners are able to track regularities of multimodal stimuli, yet it is unknown whether the statistical computations are performed on integrated representations or on separate, unimodal representations. In the present study, we investigated the ability of adults to integrate audio and visual input during statistical learning. We presented learners with a speech stream synchronized with a video of a speaker's face. In the critical condition, the visual (e.g.,/gi/) and auditory (e.g.,/mi/) signals were occasionally incongruent, which we predicted would produce the McGurk illusion, resulting in the perception of an audiovisual syllable (e.g.,/ni/). In this way, we used the McGurk illusion to manipulate the underlying statistical structure of the speech streams, such that perception of these illusory syllables facilitated participants' ability to segment the speech stream. Our results therefore demonstrate that participants can integrate audio and visual input to perceive the McGurk illusion during statistical learning. We interpret our findings as support for modality-interactive accounts of statistical learning.
UR - http://www.scopus.com/inward/record.url?scp=84904580192&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84904580192&partnerID=8YFLogxK
U2 - 10.3389/fpsyg.2014.00407
DO - 10.3389/fpsyg.2014.00407
M3 - Article
C2 - 24904449
AN - SCOPUS:84904580192
VL - 5
JO - Frontiers in Psychology
JF - Frontiers in Psychology
SN - 1664-1078
IS - MAY
M1 - 407
ER -