Psychophysical evaluation for a qualitative semantic image categorisation and retrieval approach

Zia Ul-Qayyum, A. G. Cohn, Alexander Klippel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

This paper details the behavioral evaluation of a qualitative image categorisation and retrieval approach using semantic features of images. Content based image retrieval and classification systems are highly active research areas and a cognitively plausible image description can improve effectiveness of such systems. While most approaches focus on low level image feature in order to classify images, humans, while certainly relying on some aspects of low level features, also apply high-level classifications. These high-level classification are often qualitative in nature and we have implemented a qualitative image categorisation and retrieval framework to account for human cognitive principles. While the dataset, i.e. the image database that was used for classification and retrieval purposes contained images that where annotated and therefore provided some ground truth for assessing the validity of the algorithm, we decided to add an additional behavioral evaluation step: Participants performed similarity ratings on a carefully chosen subset of picture implemented as a grouping task. Instead of using a predefined number of categories, participants could make their own choice on a) how many groups they thought were appropriate and b) which icons/images belong into these groups. The results show that the overall underlying conceptual structure created by the participants corresponds well to the classification provided through the algorithm.

Original languageEnglish (US)
Title of host publicationTrends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings
Pages321-330
Number of pages10
EditionPART 3
DOIs
StatePublished - 2010
Event23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010 - Cordoba, Spain
Duration: Jun 1 2010Jun 4 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume6098 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010
CountrySpain
CityCordoba
Period6/1/106/4/10

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Psychophysical evaluation for a qualitative semantic image categorisation and retrieval approach'. Together they form a unique fingerprint.

Cite this