Coherence in the Visual Imagination

Michael O. Vertolli, Matthew A. Kelly, Jim Davies

Research output: Contribution to journalArticle

Abstract

An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.

Original languageEnglish (US)
Pages (from-to)885-917
Number of pages33
JournalCognitive Science
Volume42
Issue number3
DOIs
StatePublished - Apr 2018

Fingerprint

Imagination
Systems Theory
Visualization
Hippocampus
Research
Schematic diagrams
System theory
Parallel algorithms
Towers

All Science Journal Classification (ASJC) codes

  • Experimental and Cognitive Psychology
  • Cognitive Neuroscience
  • Artificial Intelligence

Cite this

Vertolli, Michael O. ; Kelly, Matthew A. ; Davies, Jim. / Coherence in the Visual Imagination. In: Cognitive Science. 2018 ; Vol. 42, No. 3. pp. 885-917.
@article{86805fb6ec014e29a0700953347e8afb,
title = "Coherence in the Visual Imagination",
abstract = "An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.",
author = "Vertolli, {Michael O.} and Kelly, {Matthew A.} and Jim Davies",
year = "2018",
month = "4",
doi = "10.1111/cogs.12569",
language = "English (US)",
volume = "42",
pages = "885--917",
journal = "Cognitive Science",
issn = "0364-0213",
publisher = "Wiley-Blackwell",
number = "3",

}

Vertolli, MO, Kelly, MA & Davies, J 2018, 'Coherence in the Visual Imagination', Cognitive Science, vol. 42, no. 3, pp. 885-917. https://doi.org/10.1111/cogs.12569

Coherence in the Visual Imagination. / Vertolli, Michael O.; Kelly, Matthew A.; Davies, Jim.

In: Cognitive Science, Vol. 42, No. 3, 04.2018, p. 885-917.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Coherence in the Visual Imagination

AU - Vertolli, Michael O.

AU - Kelly, Matthew A.

AU - Davies, Jim

PY - 2018/4

Y1 - 2018/4

N2 - An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.

AB - An incoherent visualization is when aspects of different senses of a word (e.g., the biological “mouse” vs. the computer “mouse”) are present in the same visualization (e.g., a visualization of a biological mouse in the same image with a computer tower). We describe and implement a new model of creating contextual coherence in the visual imagination called Coherencer, based on the SOILIE model of imagination. We show that Coherencer is able to generate scene descriptions that are more coherent than SOILIE's original approach as well as a parallel connectionist algorithm that is considered competitive in the literature on general coherence. We also show that co-occurrence probabilities are a better association representation than holographic vectors and that better models of coherence improve the resulting output independent of the association type that is used. Theoretically, we show that Coherencer is consistent with other models of cognitive generation. In particular, Coherencer is a similar, but more cognitively plausible model than the C3 model of concept combination created by Costello and Keane (2000). We show that Coherencer is also consistent with both the modal schematic indices of perceptual symbol systems theory (Barsalou, 1999) and the amodal contextual constraints of Thagard's (2002) theory of coherence. Finally, we describe how Coherencer is consistent with contemporary research on the hippocampus, and we show evidence that the process of making a visualization coherent is serial.

UR - http://www.scopus.com/inward/record.url?scp=85046813733&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046813733&partnerID=8YFLogxK

U2 - 10.1111/cogs.12569

DO - 10.1111/cogs.12569

M3 - Article

C2 - 29124777

AN - SCOPUS:85046813733

VL - 42

SP - 885

EP - 917

JO - Cognitive Science

JF - Cognitive Science

SN - 0364-0213

IS - 3

ER -