TAC 2008 Recognizing Textual Entailment (RTE) Track

• Track coordinators:
  
Danilo Giampiccolo, CELCT (Trento), Italy (giampiccolo@celct.it)
Hoa Trang Dang, NIST, USA (hoa.dang@nist.gov)

• RTE4 Call for Participation
• Guidelines (under discussion)
• Past RTE Data  (Updated April 28, 2008)
• RTE Resource Pool
• Online Registration Deadline for RTE has been extended to June 27, 2008.

The goal of the RTE Track is to develop systems that recognize when one piece of text entails another. The RTE track at TAC continues the efforts of the PASCAL RTE Challenges. The 2008 RTE Track will include the 3-way classification task piloted in RTE-3. The goal of making a three-way decision of "YES", "NO" and "UNKNOWN" is to drive systems to make more precise informational distinctions; a hypothesis being unknown on the basis of a text should be distinguished from a hypothesis being shown false/contradicted by a text.

There is no plan to release development data for the 2008 RTE Track. Participants are invited to use Past RTE Data for development.

This initial task description is tentative and subject to modification based on discussion on the RTE Track mailing list. Please join the mailing list to keep apprised of evolving task definitions.

Schedule

Mailing List

The mailing list for the RTE Track is rte@nist.gov. The list is used to discuss and define the task guidelines for the track, as well as for general discussion related to textual entailment and its evaluation. To subscribe, send a message to listproc@email.nist.gov such that the body consists of the line:
            subscribe rte <FirstName> <LastName>
In order for your messages to get posted to the list, you must send them from the email address used when you subscribed to the list. For additional information on how to use mailing lists hosted at NIST, send a message to listproc@email.nist.gov such that the body consists of the line:
            HELP

Organizing Committee

Ido Dagan, Bar Ilan University, Israel
Hoa Trang Dang, NIST, USA
Bill Dolan, Microsoft Research, USA
Danilo Giampiccolo, CELCT (Trento), Italy
Bernardo Magnini, ITC-irst (Trento), Italy

BACK to All TAC 2008 Tracks