Neural basis of the sound-symbolic crossmodal correspondence between auditory pseudowords and visual shapes

Kelly McCormick, Simon Lacey, Randall Stilla, Lynne C. Nygaard, K. Sathian

Research output: Contribution to journalArticlepeer-review

Abstract

Sound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g., 'takete' or 'maluma', and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword-shape pairs that were soundsymbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. During attention to auditory pseudowords, however, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test competing explanations of sound symbolism, but found no evidence for mediation via language, and only limited evidence for accounts based on multisensory integration and a general magnitude system. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.

Original languageEnglish (US)
JournalMultisensory Research
DOIs
StateAccepted/In press - 2021

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Ophthalmology
  • Sensory Systems
  • Computer Vision and Pattern Recognition
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Neural basis of the sound-symbolic crossmodal correspondence between auditory pseudowords and visual shapes'. Together they form a unique fingerprint.

Cite this