Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Query Expansion Seen Through Return Order of Relevant Documents

Published

Author(s)

Walter S. Liggett Jr

Abstract

There is a reservoir of knowledge in data from the TREC evaluations that analysis of precision and recall leaves untapped. This knowledge leads to better understanding of query expansion as this paper demonstrates. In many TREC tasks, the system response required is an ordered list of 1000 document identifiers. Instead of just using the identifiers to determine the positions of relevant documents in each list, we extract from each list the identifiers of the relevant documents and compare document ordering in these sub-lists. In other words, we consider the return order of relevant documents. We use Spearman's coefficient of rank correlation to compare sub-lists and multidimensional scaling to display the comparisons. Applying this methodology to data from the TREC Query Track, specifically, to system responses to twenty restatements of each of four topics, we show how two systems with query expansion differ from four systems without. We observe return-order variations caused by topic restatement and determine how query expansion affects these variations. For some topics, query expansion reduces the sizes of these variations considerably.
Citation
Query Expansion Seen Through Return Order of Relevant Documents

Keywords

information retrieval, multidimensional scaling, query formation, rank correlation, search engines, system evaluation

Citation

Liggett, W. (2001), Query Expansion Seen Through Return Order of Relevant Documents, Query Expansion Seen Through Return Order of Relevant Documents, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=151769 (Accessed May 22, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 10, 2001, Updated February 17, 2017