Go to the NIST home page Go to the TAC Home Page TAC Banner

Return to TAC Homepage

Track Home
Schedule
Guidelines
KBP Data
Tools

KBP 2013 Home




TAC KBP 2013 Spanish Slot Filling Track (POSTPONED)

Overview

The Spanish slot filling track extends English slot filling to the cross-lingual paradigm. Given a query and a large collection of English and Spanish documents, a system should extract slot fillers for the query and present them as they appear in the source document. While the reference KB and slots in the cross-lingual slot filling task are the same as those in the monolingual English slot filling task, the cross-lingual queries may come from either English or Spanish documents.

The cross-lingual Spanish slot filling query format and system response format are the same as for the monolingual English task, with slot fillers in the language of the source document that supports the filler. No translation of slot fillers is expected, except for normalization of dates. As in the English task, systems should not return more than one response for equivalent slot fillers; two slot fillers are considered equivalent if they refer to the same entity (in the case of named entities), have the same value (in the case of dates and quantities), or have the same English translation (in the case of strings, such as for per:title and per:charges). The correctness of system responses and the equivalence of slot fillers will be judged by bi-lingual annotators.

The cross-lingual slot filling task poses additional challenges not found in the monolingual task, including the ability to process Spanish text and to determine cross-lingual equivalence between slot fillers in English and Spanish.

Schedule

    MayTrack guidelines posted
    By early JuneDistribution of document collections
    June 15Deadline for registration for track participation
    July 29 - August 12Spanish Slot Filling evaluation window
    By late SeptemberRelease of individual evaluated results to participants
    September 30Deadline for short system descriptions
    September 30Deadline for workshop presentation proposals
    mid OctoberNotification of acceptance of presentation proposals
    November 8Deadline for system reports (workshop notebook version)
    November 18-19TAC KBP 2013 workshop in Gaithersburg, Maryland, USA
    early February, 2014Deadline for system reports (final proceedings version)

Track Coordinator

Jason Duncan (U.S. Department of Defense, crosslingualsf@gmail.com)


NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Thursday, 19-Sep-2013 18:23:04 EDT
Comments to: tac-web@nist.gov