Coherence in the Visual Imagination

Michael O. Vertolli, Matthew A. Kelly, Jim Davies

Research output: Contribution to journalArticle

Abstract

An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.

Original languageEnglish (US)
Pages (from-to)885-917
Number of pages33
JournalCognitive Science
Volume42
Issue number3
DOIs
StatePublished - Apr 2018

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Coherence in the Visual Imagination'. Together they form a unique fingerprint.

  • Cite this