NIST logo

Publication Citation: Overview of the TREC 2006 Question Answering Track

NIST Authors in Bold

Author(s): Hoa T. Dang; Jimmy Lin; Diane Kelly;
Title: Overview of the TREC 2006 Question Answering Track
Published: November 05, 2008
Abstract: The TREC 2006 question answering track contained two tasks: a main task and a complex, interactive question answering (ciQA) task. As in 2005, the main task consisted of series of factoid, list, and ``Other'' questions organized around a set of targets. The ciQA task provided a framework for participants to investigate interaction in the context of complex information needs, and was a blend of the TREC 2005 QA relationship task and the TREC 2005 HARD track. Multiple assessors judged the importance of information nuggets used to evaluate the ``Other'' responses and ciQA responses, resulting in an evaluation that is more stable and discriminative than using only a single assessor to judge nugget importance.
Citation: NIST SP -
Keywords: evaluation,information/knowledge management,question answering
Research Areas: Information Delivery Systems
PDF version: PDF Document Click here to retrieve PDF version of paper (254KB)