Crossmodal visuospatial effects on auditory perception of musical contour

Simon Lacey, James Nguyen, Peter Schneider, K. Sathian

Research output: Contribution to journalArticlepeer-review

Abstract

The crossmodal correspondence between auditory pitch and visuospatial elevation (in which high- and low-pitched tones are associated with high and low spatial elevation respectively) has been proposed as the basis for Western musical notation. One implication of this is that music perception engages visuospatial processes and may not be exclusively auditory. Here, we investigated how music perception is influenced by concurrent visual stimuli. Participants listened to unfamiliar five-note musical phrases with four kinds of pitch contour (rising, falling, rising-falling, or falling-rising), accompanied by incidental visual contours that were either congruent (e.g., auditory rising/visual rising) or incongruent (e.g., auditory rising/visual falling) and judged whether the final note of the musical phrase was higher or lower in pitch than the first. Response times for the auditory judgment were significantly slower for incongruent compared to congruent trials, i.e., there was a congruency effect, even though the visual contours were incidental to the auditory task. These results suggest that music perception, although generally regarded as an auditory experience, may actually be multisensory in nature.

Original languageEnglish (US)
Pages (from-to)113-127
Number of pages15
JournalMultisensory Research
Volume34
Issue number2
DOIs
StatePublished - 2021

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Ophthalmology
  • Sensory Systems
  • Computer Vision and Pattern Recognition
  • Cognitive Neuroscience

Fingerprint Dive into the research topics of 'Crossmodal visuospatial effects on auditory perception of musical contour'. Together they form a unique fingerprint.

Cite this