Author(s)
Ellen M. Voorhees
Abstract
The TREC question answering track is an effort to bring the benefits of large-scale evaluation to bear on the question answering problem. In its third year, the track continued to focus on retrieving small snippets of text that contain an answer to a question. However, several new conditions were added to increase the realism, and the difficulty, of the task. In the main task, questions were no longer guaranteed to have an answer in the collection; systems returned a response of `NIL' to indicate their belief that no answer was present. In the new list task, systems assembled a set of instances as the response for a question, requiring the ability to distinguish among instances found in multiple documents. Another new task, the context task, required systems to track discourse objects through a series of questions.
Proceedings Title
Included in NIST SP 500-250, The Tenth Text Retrieval Conference, TREC 2001
Citation
Voorhees, E.
(2002),
Overview of the TREC 2001 Question Answering Track, Included in NIST SP 500-250, The Tenth Text Retrieval Conference, TREC 2001, CA, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=51059 (Accessed May 17, 2026)
Additional citation formats
Issues
If you have any questions about this publication or are having problems accessing it, please contact [email protected].