An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Query Expansion Seen Through Return Order of Relevant Documents
Published
Author(s)
Walter S. Liggett Jr
Abstract
There is a reservoir of knowledge in data from the TREC evaluations that analysis of precision and recall leaves untapped. This knowledge leads to better understanding of query expansion as this paper demonstrates. In many TREC tasks, the system response required is an ordered list of 1000 document identifiers. Instead of just using the identifiers to determine the positions of relevant documents in each list, we extract from each list the identifiers of the relevant documents and compare document ordering in these sub-lists. In other words, we consider the return order of relevant documents. We use Spearman's coefficient of rank correlation to compare sub-lists and multidimensional scaling to display the comparisons. Applying this methodology to data from the TREC Query Track, specifically, to system responses to twenty restatements of each of four topics, we show how two systems with query expansion differ from four systems without. We observe return-order variations caused by topic restatement and determine how query expansion affects these variations. For some topics, query expansion reduces the sizes of these variations considerably.
Citation
Query Expansion Seen Through Return Order of Relevant Documents
information retrieval, multidimensional scaling, query formation, rank correlation, search engines, system evaluation
Citation
Liggett, W.
(2001),
Query Expansion Seen Through Return Order of Relevant Documents, Query Expansion Seen Through Return Order of Relevant Documents, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=151769
(Accessed October 14, 2024)