HDBTracker

Monitoring the aggregates on dynamic hidden web databases

Weimo Liu, Saad Bin Suhaim, Saravanan Thirumuruganathan, Nan Zhang, Gautam Das, Ali Jaoua

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Numerous web databases, e.g., amazon.com, eBay.com, are "hidden" behind (i.e., accessible only through) their restrictive search and browsing interfaces. This demonstration showcases HDBTracker, a web-based system that reveals and tracks (the changes of) userspecified aggregate queries over such hidden web databases, especially those that are frequently updated, by issuing a small number of search queries through the public web interfaces of these databases. The ability to track and monitor aggregates has applications over a wide variety of domains - e.g., government agencies can track COUNT of openings at online job hunting websites to understand key economic indicators, while businesses can track the AVG price of a product over a basket of e-commerce websites to understand the competitive landscape and/or material costs. A key technique used in HDBTracker is RS-ESTIMATOR, the first algorithm that can efficiently monitor changes to aggregate query answers over a hidden web database.

Original languageEnglish (US)
Pages (from-to)1569-1572
Number of pages4
JournalProceedings of the VLDB Endowment
Volume7
Issue number13
DOIs
StatePublished - Jan 1 2014

Fingerprint

Monitoring
Websites
Demonstrations
Economics
Costs
Industry

All Science Journal Classification (ASJC) codes

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

Liu, W., Suhaim, S. B., Thirumuruganathan, S., Zhang, N., Das, G., & Jaoua, A. (2014). HDBTracker: Monitoring the aggregates on dynamic hidden web databases. Proceedings of the VLDB Endowment, 7(13), 1569-1572. https://doi.org/10.14778/2733004.2733032
Liu, Weimo ; Suhaim, Saad Bin ; Thirumuruganathan, Saravanan ; Zhang, Nan ; Das, Gautam ; Jaoua, Ali. / HDBTracker : Monitoring the aggregates on dynamic hidden web databases. In: Proceedings of the VLDB Endowment. 2014 ; Vol. 7, No. 13. pp. 1569-1572.
@article{6842b68d51bc4b949f8489b3a819ebc2,
title = "HDBTracker: Monitoring the aggregates on dynamic hidden web databases",
abstract = "Numerous web databases, e.g., amazon.com, eBay.com, are {"}hidden{"} behind (i.e., accessible only through) their restrictive search and browsing interfaces. This demonstration showcases HDBTracker, a web-based system that reveals and tracks (the changes of) userspecified aggregate queries over such hidden web databases, especially those that are frequently updated, by issuing a small number of search queries through the public web interfaces of these databases. The ability to track and monitor aggregates has applications over a wide variety of domains - e.g., government agencies can track COUNT of openings at online job hunting websites to understand key economic indicators, while businesses can track the AVG price of a product over a basket of e-commerce websites to understand the competitive landscape and/or material costs. A key technique used in HDBTracker is RS-ESTIMATOR, the first algorithm that can efficiently monitor changes to aggregate query answers over a hidden web database.",
author = "Weimo Liu and Suhaim, {Saad Bin} and Saravanan Thirumuruganathan and Nan Zhang and Gautam Das and Ali Jaoua",
year = "2014",
month = "1",
day = "1",
doi = "10.14778/2733004.2733032",
language = "English (US)",
volume = "7",
pages = "1569--1572",
journal = "Proceedings of the VLDB Endowment",
issn = "2150-8097",
publisher = "Very Large Data Base Endowment Inc.",
number = "13",

}

Liu, W, Suhaim, SB, Thirumuruganathan, S, Zhang, N, Das, G & Jaoua, A 2014, 'HDBTracker: Monitoring the aggregates on dynamic hidden web databases', Proceedings of the VLDB Endowment, vol. 7, no. 13, pp. 1569-1572. https://doi.org/10.14778/2733004.2733032

HDBTracker : Monitoring the aggregates on dynamic hidden web databases. / Liu, Weimo; Suhaim, Saad Bin; Thirumuruganathan, Saravanan; Zhang, Nan; Das, Gautam; Jaoua, Ali.

In: Proceedings of the VLDB Endowment, Vol. 7, No. 13, 01.01.2014, p. 1569-1572.

Research output: Contribution to journalArticle

TY - JOUR

T1 - HDBTracker

T2 - Monitoring the aggregates on dynamic hidden web databases

AU - Liu, Weimo

AU - Suhaim, Saad Bin

AU - Thirumuruganathan, Saravanan

AU - Zhang, Nan

AU - Das, Gautam

AU - Jaoua, Ali

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Numerous web databases, e.g., amazon.com, eBay.com, are "hidden" behind (i.e., accessible only through) their restrictive search and browsing interfaces. This demonstration showcases HDBTracker, a web-based system that reveals and tracks (the changes of) userspecified aggregate queries over such hidden web databases, especially those that are frequently updated, by issuing a small number of search queries through the public web interfaces of these databases. The ability to track and monitor aggregates has applications over a wide variety of domains - e.g., government agencies can track COUNT of openings at online job hunting websites to understand key economic indicators, while businesses can track the AVG price of a product over a basket of e-commerce websites to understand the competitive landscape and/or material costs. A key technique used in HDBTracker is RS-ESTIMATOR, the first algorithm that can efficiently monitor changes to aggregate query answers over a hidden web database.

AB - Numerous web databases, e.g., amazon.com, eBay.com, are "hidden" behind (i.e., accessible only through) their restrictive search and browsing interfaces. This demonstration showcases HDBTracker, a web-based system that reveals and tracks (the changes of) userspecified aggregate queries over such hidden web databases, especially those that are frequently updated, by issuing a small number of search queries through the public web interfaces of these databases. The ability to track and monitor aggregates has applications over a wide variety of domains - e.g., government agencies can track COUNT of openings at online job hunting websites to understand key economic indicators, while businesses can track the AVG price of a product over a basket of e-commerce websites to understand the competitive landscape and/or material costs. A key technique used in HDBTracker is RS-ESTIMATOR, the first algorithm that can efficiently monitor changes to aggregate query answers over a hidden web database.

UR - http://www.scopus.com/inward/record.url?scp=84905864445&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905864445&partnerID=8YFLogxK

U2 - 10.14778/2733004.2733032

DO - 10.14778/2733004.2733032

M3 - Article

VL - 7

SP - 1569

EP - 1572

JO - Proceedings of the VLDB Endowment

JF - Proceedings of the VLDB Endowment

SN - 2150-8097

IS - 13

ER -

Liu W, Suhaim SB, Thirumuruganathan S, Zhang N, Das G, Jaoua A. HDBTracker: Monitoring the aggregates on dynamic hidden web databases. Proceedings of the VLDB Endowment. 2014 Jan 1;7(13):1569-1572. https://doi.org/10.14778/2733004.2733032