Go to the NIST home page Go to the TAC Home Page TAC Banner

Return to TAC Homepage

KBP 2013 Tracks
  Entity Linking
  Slot Filling (SF)
  Temporal SF
  Spanish SF
  Sentiment SF
  SF Validation
  Cold Start

Call for Participation
Track Registration
Schedule
Data
Reporting Guidelines
Workshop
Organizers




TAC KBP 2013 Data

Data that are required for the TAC KBP 2013 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC KBP 2013 data is restricted to registered TAC KBP 2013 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC KBP 2013 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC cycles must register and obtain a new TAC KBP 2013 Team ID and password for 2013. Teams must also submit new (current) User Agreement forms for 2013. Once the required User Agreement forms have been received for that team, NIST will activate the TAC KBP 2013 Team ID and Password to give access to password-protected KBP 2013 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data from past KBP evaluations listed in the 2013 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration. Teams are responsible for requesting the past data that are relevant for their respective tracks.

In addition to KBP resources listed in the 2013 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement, the following KBP 2013 evaluation data have been distributed to KBP 2013 teams:

  • English Slot Filling
    • TAC 2013 KBP English Regular Slot Filling per:title Training Data - LDC2013E60 (Download from LDC's intranet) (June 17, 2013)
    • TAC 2013 KBP English Regular Slot Filling Evaluation Queries - LDC2013R14 (Download here) (July 22, 2013)
    • TAC 2013 KBP English Regular Slot Filling Evaluation Assessment Results V1.1 - LDC2013E91 (Download here) (October 24, 2013)
    • TAC 2013 KBP English Regular Slot Filling Evaluation Summary Statistics (Download here) (October 25, 2013)

  • Temporal Slot Filling
    • TAC 2011 KBP English Temporal Slot Filling Assessment Results V1.1 - LDC2013E65 (Download from LDC's intranet) (July 26, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Training Queries and Annotations - LDC2013E82 (Download from LDC's intranet) (August 9, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Evaluation Queries - LDC2013R16 (Download here) (August 12, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Evaluation Queries and Annotations - LDC2013E86 (Download here) (November 7, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Evaluation Assessment Results - LDC2013E99 (Download here) (November 7, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Scorer and Auxiliary Files (Download here) (November 8, 2013)
    • TAC 2013 KBP English Temporal Slot Filling Evaluation Summary Statistics (Download here) (November 8, 2013)

  • Sentiment Slot Filling
    • TAC 2013 KBP English Sentiment Slot Filling Sample Queries and Annotations V1.1 - LDC2013E61 (Superseded by LDC2013E78)
    • TAC 2013 KBP English Sentiment Slot Filling Training Queries and Annotations V1.0 - LDC2013E78 (Download from LDC's intranet) (August 9, 2013)
    • TAC 2013 KBP English Source Corpus SERIF Annotation (Download here) (Updated September 1, 2013)
    • TAC 2013 KBP English Sentiment Slot Filling Evaluation Queries - LDC2013R24 (Download here) (August 26, 2013)
    • TAC 2013 KBP English Sentiment Slot Filling Evaluation Assessment Results - LDC2013E100 (Download here) (October 25, 2013)

  • Cold Start
    • Cold Start 2013 Example Documents, with validator and sample submissions (V2.0) (Download here) (July 31, 2013)
    • Cold Start 2013 Sample Corpus (Download here) (August 12, 2013)
    • Cold Start 2013 Evaluation Corpus (Download here) (Updated August 16, 2013)
    • TAC 2013 KBP English Cold Start Evaluation Assessment Results - LDC2013E101 (Download here) (November 7, 2013)

  • Slot Filler Validation
    • TAC 2013 KBP Slot Filler Validation Evaluation Queries V1.1 (Download here) (Updated September 5, 2013)
    • TAC 2013 KBP English Regular Slot Filling Evaluation Assessment Results PRELIMINARY V1.3.5 (Download here) (Updated September 18, 2013)

  • Entity Linking
    • TAC 2013 KBP English Entity Linking Evaluation Queries V1.1 - LDC2013R30 (Download here) (September 9, 2013)
    • TAC 2013 KBP Chinese Entity Linking Evaluation Queries - LDC2013R31 (Download here) (September 16, 2013)
    • TAC 2013 KBP Spanish Entity Linking Evaluation Queries - LDC2013R32 (Download here) (September 16, 2013)
    • TAC 2013 KBP English Entity Linking Evaluation Queries and Knowledge Base Links V1.1 - LDC2013E90 (Download here) (December 6, 2013)
    • TAC 2013 KBP English Entity Linking Evaluation Results (Download here) (January 30, 2014)
    • TAC 2013 KBP Chinese Entity Linking Evaluation Queries and Knowledge Base Links V1.3 - LDC2013E96 (Download here) (January 30, 2014)
    • TAC 2013 KBP Chinese Entity Linking Evaluation Results (Download here) (January 30, 2014)
    • TAC 2013 KBP Spanish Entity Linking Evaluation Queries and Knowledge Base Links V1.1 - LDC2013E97 (Download here) (January 30, 2014)
    • TAC 2013 KBP Spanish Entity Linking Evaluation Results (Download here) (January 30, 2014)


NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Thursday, 30-Jan-2014 16:28:38 EST
Comments to: tac-web@nist.gov