Individual Query Cardinality Estimation using Multiple Query Combinations on a Search Engine's Corpus

Fahad Islam, Abdelaali Hassaine, Ali Jaoua, Gautam Das, Nan Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Most modern search engines feature keyword based search interfaces. These interfaces are usually found on websites belonging to enterprises or governments or sites related to news articles, blogs and social media that contain a large corpus of documents. These collections of documents are not easily indexed by web search engines, and are considered as hidden web databases. These databases provide opportunities for data analysis for many third-parties through their keyword search interfaces. A significant amount of research has already been carried out on analyzing and extracting aggregate information about these hidden document corpora. But most of these research focus on the high level big-picture information of the database. Not enough focus has been done on extracting analytical information which is specific to individual queries. This paper focuses on that analysis gap and takes ideas from other existing research to formulate a query cardinality estimation technique i.e. The count of documents matching a query in the document corpus of a search engine. We experimentally assess the effectiveness of our method by building a search engine on the Reuters-21578 document corpus. For a given keyword the corresponding documents' count is estimated only by sending search queries using the interface.

Original languageEnglish (US)
Title of host publication2017 International Conference on Computer and Applications, ICCA 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages312-316
Number of pages5
ISBN (Electronic)9781538627525
DOIs
Publication statusPublished - Oct 20 2017
Event2017 International Conference on Computer and Applications, ICCA 2017 - Doha, United Arab Emirates
Duration: Sep 6 2017Sep 7 2017

Publication series

Name2017 International Conference on Computer and Applications, ICCA 2017

Other

Other2017 International Conference on Computer and Applications, ICCA 2017
CountryUnited Arab Emirates
CityDoha
Period9/6/179/7/17

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Optimization
  • Education
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Islam, F., Hassaine, A., Jaoua, A., Das, G., & Zhang, N. (2017). Individual Query Cardinality Estimation using Multiple Query Combinations on a Search Engine's Corpus. In 2017 International Conference on Computer and Applications, ICCA 2017 (pp. 312-316). [8079753] (2017 International Conference on Computer and Applications, ICCA 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/COMAPP.2017.8079753