U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Search Publications by:

Search Title, Abstract, Conference, Citation, Keyword or Author
Displaying 26 - 50 of 64

The Eleventh Text REtrieval Conference (TREC-11)

May 1, 2003
Author(s)
Ellen M. Voorhees, Donna K. Harman
The Eleventh Text Retrieval Conference was held in Gaithersburg, Maryland, November 19-22, 2002. TREC 2002 is the latest in a series of workshops designed to foster research in information retrieval and related tasks. This year's conference consisted of

Overview of the TREC 2002 Novelty Track

April 1, 2003
Author(s)
Donna K. Harman
The novelty track was a new track in TREC-11. The basic task was as follows: given a TREC topic and an ordered list of relevant documents (ordered by relevance ranking), find the relevant and novel sentences that should be returned to the user from this

The Development and Evolution of TREC and DUC

October 1, 2002
Author(s)
Donna K. Harman
The Text REtrieval Conference (TREC) has been running for 11 years now, with 93 participants in the last round of evaluation. This paper chronicles the changes in TREC over that time, emphasizing the evolution in the tasks that were evaluated rather than

The Tenth Text Retrieval Conference, TREC- 2001

April 1, 2002
Author(s)
Ellen M. Voorhees, Donna K. Harman
TREC 2001 is the latest in a series of workshops designed to foster research in information retrieval and related tasks. This year's conference consisted of six different tasks, including a new task on content-based retrieval of digital video. The overview

The DUC Summarization Evaluations

March 1, 2002
Author(s)
Donna K. Harman, Paul D. Over
There has been a long history of research in text summarization by both the text retrieval and the natural language processing communities, but evaluation of this research has always presented problems. In 2001 NIST launched a new text summarization

The Ninth Text REtrieval Conference (TREC-9)

October 1, 2001
Author(s)
Ellen M. Voorhees, Donna K. Harman
This paper provides an overview of the ninth Text REtrieval Conference (TREC-9) held in Gaithersburg, Maryland, November 13-16, 2000. TREC-9 is the latest in a series of workshops designed to foster research in text retrieval. This year's conference

The Importance of Focused Evaluations: A Case Study of TREC and DUC

March 1, 2001
Author(s)
Donna K. Harman
Evaluation has always been an important part of scientific research, and in information retrieval, this evaluation has mostly been done using test collections. In 1992, a new test collection was built at the National Institute of Standards and Technology

CLIR Evaluation at TREC

January 1, 2001
Author(s)
Donna K. Harman, M C. Braschler, M Hess, M Kluck, C Peters, P Schauble, P Sheridan
Starting in 1997, the National Institute of Standards and Technology conducted 3 years of evaluation of cross-language information retrieval systems in the Text REtrieval Conference (TREC). Twenty-two participating systems used topics (test questions) in

The Eighth Text REtrieval Conference (TREC-8)

November 1, 2000
Author(s)
Ellen M. Voorhees, Donna K. Harman
This report constitutes the proceedings of the eighth Text REtrieval Conference (TREC-8) held in Gaithersburg, Maryland, November 16, 1999. The conference was co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense

Overview of the Sixth Text REtrieval Conference (TREC-6)

October 25, 1999
Author(s)
Ellen M. Voorhees, Donna K. Harman
The Text REtrieval Conference is a workshop series designed to encourage research on text retrieval for realistic applications by providing large test collections, uniform scoring procedures, and a forum for organizations interested in comparing results

The Seventh Text REtrieval Conference (TREC-7)

July 1, 1999
Author(s)
Ellen M. Voorhees, Donna K. Harman
This report constitutes the proceedings of the seventh Text REtrieval Conference (TREC-7) held in Gaithersburg, Maryland, November 9-11, 1998. The conference was co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense

Results and Challenges in Web Search Evaluation

March 1, 1999
Author(s)
D Hawking, Nick Craswell, P Thistlewaite, Donna Harman
A frozen 18.5 million page snapshot of part of the Web has been created to enable and encourage meaningful and reproducible evaluation of Web search systems and techniques. This collection is being used in an evaluation framework within the Text Retrieval
Was this page helpful?