Comparison of major web search engine overlap

2005 and 2007

Amanda Spink, Bernard J. Jansen, Changru Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper provides preliminary results from a study examining the overlap among results retrieved by four major Web search engines for a large set of more than 19,332 queries. Previous studies show the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across four major Web search engines - Google, Live, Ask, and Yahoo! - using a large number of randomly selected Infospace, Inc queries from April 2007. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the four major Web search engines was 88.3 percent, with 8.9 percent of total search results found on two of the four Web search engines, 2.2 percent on three engines and 0.6 percent of results found across all four Web search engines. This level of Web search engine overlap is smaller than data from July 2005 and reflects the growing differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

Original languageEnglish (US)
Title of host publicationAusWeb 2008: 14th Australasian World Wide Web Conference
StatePublished - 2008
Event14th Australasian World Wide Web Conference, AusWeb 2008 - Ballina, NSW, Australia
Duration: Apr 5 2008Apr 9 2008

Other

Other14th Australasian World Wide Web Conference, AusWeb 2008
CountryAustralia
CityBallina, NSW
Period4/5/084/9/08

Fingerprint

Search engines
World Wide Web
Engines

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Software

Cite this

Spink, A., Jansen, B. J., & Wang, C. (2008). Comparison of major web search engine overlap: 2005 and 2007. In AusWeb 2008: 14th Australasian World Wide Web Conference
Spink, Amanda ; Jansen, Bernard J. ; Wang, Changru. / Comparison of major web search engine overlap : 2005 and 2007. AusWeb 2008: 14th Australasian World Wide Web Conference. 2008.
@inproceedings{dc5541924c2740cc98ae8e180786c5af,
title = "Comparison of major web search engine overlap: 2005 and 2007",
abstract = "This paper provides preliminary results from a study examining the overlap among results retrieved by four major Web search engines for a large set of more than 19,332 queries. Previous studies show the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across four major Web search engines - Google, Live, Ask, and Yahoo! - using a large number of randomly selected Infospace, Inc queries from April 2007. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the four major Web search engines was 88.3 percent, with 8.9 percent of total search results found on two of the four Web search engines, 2.2 percent on three engines and 0.6 percent of results found across all four Web search engines. This level of Web search engine overlap is smaller than data from July 2005 and reflects the growing differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.",
author = "Amanda Spink and Jansen, {Bernard J.} and Changru Wang",
year = "2008",
language = "English (US)",
booktitle = "AusWeb 2008: 14th Australasian World Wide Web Conference",

}

Spink, A, Jansen, BJ & Wang, C 2008, Comparison of major web search engine overlap: 2005 and 2007. in AusWeb 2008: 14th Australasian World Wide Web Conference. 14th Australasian World Wide Web Conference, AusWeb 2008, Ballina, NSW, Australia, 4/5/08.

Comparison of major web search engine overlap : 2005 and 2007. / Spink, Amanda; Jansen, Bernard J.; Wang, Changru.

AusWeb 2008: 14th Australasian World Wide Web Conference. 2008.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Comparison of major web search engine overlap

T2 - 2005 and 2007

AU - Spink, Amanda

AU - Jansen, Bernard J.

AU - Wang, Changru

PY - 2008

Y1 - 2008

N2 - This paper provides preliminary results from a study examining the overlap among results retrieved by four major Web search engines for a large set of more than 19,332 queries. Previous studies show the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across four major Web search engines - Google, Live, Ask, and Yahoo! - using a large number of randomly selected Infospace, Inc queries from April 2007. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the four major Web search engines was 88.3 percent, with 8.9 percent of total search results found on two of the four Web search engines, 2.2 percent on three engines and 0.6 percent of results found across all four Web search engines. This level of Web search engine overlap is smaller than data from July 2005 and reflects the growing differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

AB - This paper provides preliminary results from a study examining the overlap among results retrieved by four major Web search engines for a large set of more than 19,332 queries. Previous studies show the lack of overlap in results returned by Web search engines for the same queries. Our large-scale study measured the overlap of first page results (both non-sponsored and sponsored) across four major Web search engines - Google, Live, Ask, and Yahoo! - using a large number of randomly selected Infospace, Inc queries from April 2007. We then compared the results to results retrieved for the same queries from the meta-search engine Dogpile.com. The percent of total results unique to only one of the four major Web search engines was 88.3 percent, with 8.9 percent of total search results found on two of the four Web search engines, 2.2 percent on three engines and 0.6 percent of results found across all four Web search engines. This level of Web search engine overlap is smaller than data from July 2005 and reflects the growing differences in Web search engines retrieval and ranking results. Results point to the value of meta-search engines in Web retrieval to overcome the biases of individual search engines.

UR - http://www.scopus.com/inward/record.url?scp=84873246643&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84873246643&partnerID=8YFLogxK

M3 - Conference contribution

BT - AusWeb 2008: 14th Australasian World Wide Web Conference

ER -

Spink A, Jansen BJ, Wang C. Comparison of major web search engine overlap: 2005 and 2007. In AusWeb 2008: 14th Australasian World Wide Web Conference. 2008