Monsters at the gate: When softbots visit web search engines

Bernard J. Jansen, Amanda S. Spink, Jan Pedersen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

There has been little research investigating how Web agents search for information. We focused on three research questions: (i) How do agents interact with Web search engines? (2). What type of information are Web agents looking for and in what quantity?, and (3) What is the duration and frequency of Web agent interactions The queries examined for this study were submitted to Alta Vista on 8 September 2002, spanning a 24-hour period. Findings include: (1) when agents interact with Web search engines they use simpler queries than those submitted by human searchers, (2) Web agents are searching for a wide variety of information, with 60% of the terms used being unique, and (3) agent - Web search engine interaction is typically over several hours with multiple instances of interaction per second. Implications for Web agents and search engines are discussed.

Original languageEnglish (US)
Title of host publicationProceedings of the International Conference on Internet Computing, IC 03
EditorsP. Langendoerfer, O. Droegehorn
Pages620-626
Number of pages7
Volume2
StatePublished - 2003
EventProceedings of the International Conference on Internet Computing, IC'03 - Las Vegas, NV, United States
Duration: Jun 23 2003Jun 26 2003

Other

OtherProceedings of the International Conference on Internet Computing, IC'03
CountryUnited States
CityLas Vegas, NV
Period6/23/036/26/03

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Monsters at the gate: When softbots visit web search engines'. Together they form a unique fingerprint.

  • Cite this

    Jansen, B. J., Spink, A. S., & Pedersen, J. (2003). Monsters at the gate: When softbots visit web search engines. In P. Langendoerfer, & O. Droegehorn (Eds.), Proceedings of the International Conference on Internet Computing, IC 03 (Vol. 2, pp. 620-626)