Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search

Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, Filip Radlinski, Geri Gay

Research output: Contribution to journalArticle

345 Scopus citations

Abstract

This article examines the reliability of implicit feedback generated from clickthrough data and query reformulations in World Wide Web (WWW) search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average. We find that such relative preferences are accurate not only between results from an individual query, but across multiple sets of results within chains of query reformulations.

Original languageEnglish (US)
Article number1229181
JournalACM Transactions on Information Systems
Volume25
Issue number2
DOIs
StatePublished - Apr 1 2007

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Business, Management and Accounting(all)
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search'. Together they form a unique fingerprint.

  • Cite this