Overlap among major Web search engines

Amanda Spink, Bernard J. Jansen, Chris Blakely, Sherry Koshman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

Our study examined the overlap among results retrieved by three major Web search engines for a large set of more than 10,316 queries. Previous smaller studies have discussed the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across three major Web search engines - Google, Ask Jeeves and Yahoo - using a large number of randomly selected Dogpile.com queries submitted within a 24 hour - 36 hour period. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the three major Web search engines was 85%. 12% of total search results were found on two of the three Web search engines, and 3% of results were found across all three Web search engines. This small level of overlap reflects major differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

Original languageEnglish (US)
Title of host publicationProceedings - Third International Conference onInformation Technology
Subtitle of host publicationNew Generations, ITNG 2006
Pages370-374
Number of pages5
DOIs
StatePublished - Nov 14 2006
EventThird International Conference on Information Technology: New Generations, ITNG 2006 - Las Vegas, NV, United States
Duration: Apr 10 2006Apr 12 2006

Publication series

NameProceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006
Volume2006

Other

OtherThird International Conference on Information Technology: New Generations, ITNG 2006
CountryUnited States
CityLas Vegas, NV
Period4/10/064/12/06

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Fingerprint Dive into the research topics of 'Overlap among major Web search engines'. Together they form a unique fingerprint.

  • Cite this

    Spink, A., Jansen, B. J., Blakely, C., & Koshman, S. (2006). Overlap among major Web search engines. In Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006 (pp. 370-374). [1611621] (Proceedings - Third International Conference onInformation Technology: New Generations, ITNG 2006; Vol. 2006). https://doi.org/10.1109/ITNG.2006.117