A mutual semantic endorsement approach to image retrieval and context provision

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations

Abstract

Learning semantics from annotated images to enhance content-based retrieval is an important research direction. In this paper, annotation data are assumed available for only a subset of images inside the database. An on the fly learning method is developed to capture the semantics of query images. Specifically, the semantics of annotated images in a visual proximity of a query are compared with each other to determine the amount of mutual endorsement. An image is considered endorsed by another if they possess similar semantics. Annotations with high mutual endorsement are used to narrow down a candidate pool of images. The new retrieval method is inherently dynamic and treats seamlessly different forms of annotation data. Experiments show that semantic endorsement can increase precision by as much as 70% in average for a wide range of parameter settings. We also develop a context provision mechanism to reveal the relationship between a query and semantic clusters extracted from the database. Context helps users explore the content of a database and provides a platform for them to tailor searches by stressing different perspectives in the interpretation of a query.

Original languageEnglish (US)
Title of host publicationMIR 2005 - Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Co-located with ACM Multimedia 2005
PublisherAssociation for Computing Machinery, Inc
Pages173-182
Number of pages10
ISBN (Electronic)1595932445, 9781595932440
StatePublished - Nov 10 2005
Event7th ACM SIGMM International Workshop on Multimedia Information Retrieval, MIR 2005 - Singapore, Singapore
Duration: Nov 10 2005Nov 11 2005

Publication series

NameMIR 2005 - Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Co-located with ACM Multimedia 2005

Other

Other7th ACM SIGMM International Workshop on Multimedia Information Retrieval, MIR 2005
CountrySingapore
CitySingapore
Period11/10/0511/11/05

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Information Systems
  • Signal Processing
  • Software
  • Media Technology

Cite this

Li, J. (2005). A mutual semantic endorsement approach to image retrieval and context provision. In MIR 2005 - Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Co-located with ACM Multimedia 2005 (pp. 173-182). (MIR 2005 - Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, Co-located with ACM Multimedia 2005). Association for Computing Machinery, Inc.