Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Overview of the TREC 2001 Question Answering Track

Published

Author(s)

Ellen M. Voorhees

Abstract

The TREC question answering track is an effort to bring the benefits of large-scale evaluation to bear on the question answering problem. In its third year, the track continued to focus on retrieving small snippets of text that contain an answer to a question. However, several new conditions were added to increase the realism, and the difficulty, of the task. In the main task, questions were no longer guaranteed to have an answer in the collection; systems returned a response of `NIL' to indicate their belief that no answer was present. In the new list task, systems assembled a set of instances as the response for a question, requiring the ability to distinguish among instances found in multiple documents. Another new task, the context task, required systems to track discourse objects through a series of questions.
Proceedings Title
Included in NIST SP 500-250, The Tenth Text Retrieval Conference, TREC 2001
Conference Location
CA

Citation

Voorhees, E. (2002), Overview of the TREC 2001 Question Answering Track, Included in NIST SP 500-250, The Tenth Text Retrieval Conference, TREC 2001, CA, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=51059 (Accessed April 26, 2024)
Created April 1, 2002, Updated February 17, 2017