The story picturing engine - A system for automatic text illustration

Dhiraj Joshi, James Wang, Jia Li

Research output: Contribution to journalArticle

73 Citations (Scopus)

Abstract

We present an unsupervised approach to automated story picturing. Semantic keywords are extracted from the story, an annotated image database is searched. Thereafter, a novel image ranking scheme automatically determines the importance of each image. Both lexical annotations and visual content play a role in determining the ranks. Annotations are processed using the Wordnet. A mutual reinforcement-based rank is calculated for each image. We have implemented the methods in our Story Picturing Engine (SPE) system. Experiments on large-scale image databases are reported. A user study has been performed and statistical analysis of the results has been presented.

Original languageEnglish (US)
Pages (from-to)68-89
Number of pages22
JournalACM Transactions on Multimedia Computing, Communications and Applications
Volume2
Issue number1
DOIs
StatePublished - Jan 1 2006

Fingerprint

Engines
Statistical methods
Reinforcement
Semantics
Experiments

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

@article{888de02bd4a5427c9b78e6fa8989134d,
title = "The story picturing engine - A system for automatic text illustration",
abstract = "We present an unsupervised approach to automated story picturing. Semantic keywords are extracted from the story, an annotated image database is searched. Thereafter, a novel image ranking scheme automatically determines the importance of each image. Both lexical annotations and visual content play a role in determining the ranks. Annotations are processed using the Wordnet. A mutual reinforcement-based rank is calculated for each image. We have implemented the methods in our Story Picturing Engine (SPE) system. Experiments on large-scale image databases are reported. A user study has been performed and statistical analysis of the results has been presented.",
author = "Dhiraj Joshi and James Wang and Jia Li",
year = "2006",
month = "1",
day = "1",
doi = "10.1145/1126004.1126008",
language = "English (US)",
volume = "2",
pages = "68--89",
journal = "ACM Transactions on Multimedia Computing, Communications and Applications",
issn = "1551-6857",
publisher = "Association for Computing Machinery (ACM)",
number = "1",

}

The story picturing engine - A system for automatic text illustration. / Joshi, Dhiraj; Wang, James; Li, Jia.

In: ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 2, No. 1, 01.01.2006, p. 68-89.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The story picturing engine - A system for automatic text illustration

AU - Joshi, Dhiraj

AU - Wang, James

AU - Li, Jia

PY - 2006/1/1

Y1 - 2006/1/1

N2 - We present an unsupervised approach to automated story picturing. Semantic keywords are extracted from the story, an annotated image database is searched. Thereafter, a novel image ranking scheme automatically determines the importance of each image. Both lexical annotations and visual content play a role in determining the ranks. Annotations are processed using the Wordnet. A mutual reinforcement-based rank is calculated for each image. We have implemented the methods in our Story Picturing Engine (SPE) system. Experiments on large-scale image databases are reported. A user study has been performed and statistical analysis of the results has been presented.

AB - We present an unsupervised approach to automated story picturing. Semantic keywords are extracted from the story, an annotated image database is searched. Thereafter, a novel image ranking scheme automatically determines the importance of each image. Both lexical annotations and visual content play a role in determining the ranks. Annotations are processed using the Wordnet. A mutual reinforcement-based rank is calculated for each image. We have implemented the methods in our Story Picturing Engine (SPE) system. Experiments on large-scale image databases are reported. A user study has been performed and statistical analysis of the results has been presented.

UR - http://www.scopus.com/inward/record.url?scp=33745125045&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745125045&partnerID=8YFLogxK

U2 - 10.1145/1126004.1126008

DO - 10.1145/1126004.1126008

M3 - Article

VL - 2

SP - 68

EP - 89

JO - ACM Transactions on Multimedia Computing, Communications and Applications

JF - ACM Transactions on Multimedia Computing, Communications and Applications

SN - 1551-6857

IS - 1

ER -