PASCAL Recognizing Textual Entailment Challenge (RTE-5) at TAC 2009
Given two text fragments called 'Text' and 'Hypothesis', Textual Entailment Recognition is the task of determining whether the meaning of the Hypothesis is entailed (can be inferred) from the Text. The goal of the first RTE Challenge was to provide the NLP community with a benchmark to test progress in recognizing textual entailment, and to compare the achievements of different groups. Since its inception in 2004, the PASCAL RTE Challenges have promoted research in textual entailment recognition as a generic task that captures major semantic inference needs across many natural language processing applications, such as Question Answering (QA), Information Retrieval (IR), Information Extraction (IE), and multi-document summarization.
After the first three highly successful PASCAL RTE Challenges, RTE became a track at the 2008 Text Analysis Conference, which brought it together with communities working on NLP applications (specifically, QA and summarization). The interaction has provided the opportunity to apply RTE systems to specific applications and to move the RTE task towards more realistic application scenarios.
What's new in RTE-5
The main RTE-5 task is similar to the RTE-4 task, with the following changes:
In addition to the main task (Textual Entailment Recognition), RTE-5 will offer a new Textual Entailment Search pilot that is situated in the summarization application setting, where the task would be to find all Texts in a set of documents that entail a given Hypothesis.
The mailing list for the RTE Track is firstname.lastname@example.org. The list is used to discuss and define the task guidelines for the track, as well as for general discussion related to textual entailment and its evaluation. To subscribe, send a message to email@example.com such that the body consists of the line:
Ido Dagan, Bar Ilan University, Israel
Hoa Trang Dang, NIST, USA
Danilo Giampiccolo, CELCT, Italy
Bernardo Magnini, FBK, Italy
NIST is an agency of the
U.S. Department of Commerce
Last updated: Friday, 01-Apr-2011 12:40:17 EDT
Comments to: firstname.lastname@example.org