Automatic image description based on textual data

Youakim Badr, Richard Chbeir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In the last two decades, images are quite produced in increasing amounts in several application domains. In medicine, for instance, a large number of images of various imaging modalities (e.g. computer tomography, magnetic resonance, nuclear imaging, etc.) are produced daily to support clinical decision-making. Thereby, a fully functional Image Management System becomes a requirement to the end-users. In spite of current researches, the practice has proved that the problem of image management is highly related to image representation. This paper contribution is twofold in facilitating the representation of images and the extraction of its content and context descriptors. In fact, we introduce an expressiveness and extendable XML-based meta-model able to capture the metadata and content-based of images. We also propose an information extraction approach to provide automatic description of image content using related metadata. It automatically generates XML instances, which mark up metadata and salient objects matched by extraction patterns. In this paper, we illustrate our proposal by using the medical domain of lungs x-rays and we show our first experimental results.

Original languageEnglish (US)
Title of host publicationJournal on Data Semantics VII
Pages196-218
Number of pages23
StatePublished - Dec 1 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4244 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Fingerprint

Metadata
XML
Imaging techniques
Medicine
Tomography
Decision making
Nuclear magnetic resonance
X rays
Imaging
Image Representation
Nuclear Magnetic Resonance
Information Extraction
Expressiveness
Metamodel
Lung
Modality
Descriptors
Decision Making
Requirements
Experimental Results

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Badr, Y., & Chbeir, R. (2006). Automatic image description based on textual data. In Journal on Data Semantics VII (pp. 196-218). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4244 LNCS).
Badr, Youakim ; Chbeir, Richard. / Automatic image description based on textual data. Journal on Data Semantics VII. 2006. pp. 196-218 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{331a397e703e4af5a7a998438a1f6c54,
title = "Automatic image description based on textual data",
abstract = "In the last two decades, images are quite produced in increasing amounts in several application domains. In medicine, for instance, a large number of images of various imaging modalities (e.g. computer tomography, magnetic resonance, nuclear imaging, etc.) are produced daily to support clinical decision-making. Thereby, a fully functional Image Management System becomes a requirement to the end-users. In spite of current researches, the practice has proved that the problem of image management is highly related to image representation. This paper contribution is twofold in facilitating the representation of images and the extraction of its content and context descriptors. In fact, we introduce an expressiveness and extendable XML-based meta-model able to capture the metadata and content-based of images. We also propose an information extraction approach to provide automatic description of image content using related metadata. It automatically generates XML instances, which mark up metadata and salient objects matched by extraction patterns. In this paper, we illustrate our proposal by using the medical domain of lungs x-rays and we show our first experimental results.",
author = "Youakim Badr and Richard Chbeir",
year = "2006",
month = "12",
day = "1",
language = "English (US)",
isbn = "3540463291",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "196--218",
booktitle = "Journal on Data Semantics VII",

}

Badr, Y & Chbeir, R 2006, Automatic image description based on textual data. in Journal on Data Semantics VII. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4244 LNCS, pp. 196-218.

Automatic image description based on textual data. / Badr, Youakim; Chbeir, Richard.

Journal on Data Semantics VII. 2006. p. 196-218 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4244 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Automatic image description based on textual data

AU - Badr, Youakim

AU - Chbeir, Richard

PY - 2006/12/1

Y1 - 2006/12/1

N2 - In the last two decades, images are quite produced in increasing amounts in several application domains. In medicine, for instance, a large number of images of various imaging modalities (e.g. computer tomography, magnetic resonance, nuclear imaging, etc.) are produced daily to support clinical decision-making. Thereby, a fully functional Image Management System becomes a requirement to the end-users. In spite of current researches, the practice has proved that the problem of image management is highly related to image representation. This paper contribution is twofold in facilitating the representation of images and the extraction of its content and context descriptors. In fact, we introduce an expressiveness and extendable XML-based meta-model able to capture the metadata and content-based of images. We also propose an information extraction approach to provide automatic description of image content using related metadata. It automatically generates XML instances, which mark up metadata and salient objects matched by extraction patterns. In this paper, we illustrate our proposal by using the medical domain of lungs x-rays and we show our first experimental results.

AB - In the last two decades, images are quite produced in increasing amounts in several application domains. In medicine, for instance, a large number of images of various imaging modalities (e.g. computer tomography, magnetic resonance, nuclear imaging, etc.) are produced daily to support clinical decision-making. Thereby, a fully functional Image Management System becomes a requirement to the end-users. In spite of current researches, the practice has proved that the problem of image management is highly related to image representation. This paper contribution is twofold in facilitating the representation of images and the extraction of its content and context descriptors. In fact, we introduce an expressiveness and extendable XML-based meta-model able to capture the metadata and content-based of images. We also propose an information extraction approach to provide automatic description of image content using related metadata. It automatically generates XML instances, which mark up metadata and salient objects matched by extraction patterns. In this paper, we illustrate our proposal by using the medical domain of lungs x-rays and we show our first experimental results.

UR - http://www.scopus.com/inward/record.url?scp=38749096334&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38749096334&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:38749096334

SN - 3540463291

SN - 9783540463290

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 196

EP - 218

BT - Journal on Data Semantics VII

ER -

Badr Y, Chbeir R. Automatic image description based on textual data. In Journal on Data Semantics VII. 2006. p. 196-218. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).