Crawling Hidden Objects with kNN Queries

Hui Yan, Zhiguo Gong, Nan Zhang, Tao Huang, Hua Zhong, Jun Wei

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Many websites offering Location Based Services (LBS) provide a k NN search interface that returns the top-k nearest-neighbor objects (e.g., nearest restaurants) for a given query location. This paper addresses the problem of crawling all objects efficiently from an LBS website, through the public k NN web search interface it provides. Specifically, we develop crawling algorithm for 2D and higher-dimensional spaces, respectively, and demonstrate through theoretical analysis that the overhead of our algorithms can be bounded by a function of the number of dimensions and the number of crawled objects, regardless of the underlying distributions of the objects. We also extend the algorithms to leverage scenarios where certain auxiliary information about the underlying data distribution, e.g., the population density of an area which is often positively correlated with the density of LBS objects, is available. Extensive experiments on real-world datasets demonstrate the superiority of our algorithms over the state-of-the-art competitors in the literature.

Original languageEnglish (US)
Article number7335622
Pages (from-to)912-924
Number of pages13
JournalIEEE Transactions on Knowledge and Data Engineering
Volume28
Issue number4
DOIs
StatePublished - Apr 1 2016

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'Crawling Hidden Objects with kNN Queries'. Together they form a unique fingerprint.

  • Cite this

    Yan, H., Gong, Z., Zhang, N., Huang, T., Zhong, H., & Wei, J. (2016). Crawling Hidden Objects with kNN Queries. IEEE Transactions on Knowledge and Data Engineering, 28(4), 912-924. [7335622]. https://doi.org/10.1109/TKDE.2015.2502947