Overview of the TREC 2001 Question Answering Track

Published

November 26, 2001

Author(s)

Ellen M. Voorhees

Abstract

The TREC question answering track is an effort to bring the benefits of large-scale evaluation to bear on the question answering problem. In its third year, the track continued to focus on retrieving small snippets of text that contain an answer to a question. However, several new conditions were added to increase the realism, and the difficulty, of the task. In the main task, questions were no longer guaranteed to have an answer in the collection; systems returned a response of NIL to indicate their belief that no answer was present. In the new list task, systems assembled a set of instances as the response for a question, requiring the ability to distinguish among instances found in multiple documents. Another new task, the context task, required systems to track discourse objects through a series of questions.

Citation

Overview of the TREC 2001 Question Answering Track

Pub Type

Others

Download Paper

Local Download

Keywords

question answering, TREC

Citation

Voorhees, E. (2001), Overview of the TREC 2001 Question Answering Track, Overview of the TREC 2001 Question Answering Track, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=151549 (Accessed May 20, 2024)