TAC KBP 2015 Data

Data that are required for the TAC KBP 2015 tracks are distributed at no cost to track participants. Whenever possible, data are distributed by NIST or the Linguistic Data Consortium via Web download; data are mailed as physical disks only if they cannot be made available for download.

Access to TAC KBP 2015 data is restricted to registered TAC KBP 2015 participants who have submitted all the required User Agreement forms. Each participating team will provide a TAC KBP 2015 Team ID and will receive a Team Password upon registration. Teams that have participated in past TAC evaluations must register and obtain a new TAC KBP 2015 Team ID and password for 2015. Teams must also submit new (current) User Agreement forms for 2015. Once the required User Agreement forms have been received for that team, NIST will activate the TAC KBP 2015 Team ID and Password to give access to password-protected KBP 2015 resources that are distributed by NIST (a different username and password are required for data that are downloaded from LDC's intranet).

Data resources from past KBP evaluations listed in the 2015 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement are available for system development and must be requested by name and catalog number from the LDC upon registration; teams are responsible for requesting the past KBP data that are relevant for their respective tracks when submitting the Evaluation License Agreement to the LDC. When additional KBP 2015 data become available for each track, they will automatically be distributed to KBP 2015 teams registered for that track.

In addition to KBP resources listed in the 2015 Text Analysis Conference (TAC) Knowledge Base Population Evaluation License Agreement, the following KBP 2015 evaluation data have been distributed to KBP 2015 teams that are registered for each track:

• Tri-Lingual Entity Discovery and Linking Track
• TAC KBP 2014 English EDL Runs (Download here) (March 1, 2016)
• TAC KBP 2015 Tri-Lingual EDL Submitted Runs (Download here) (March 1, 2016)
• TAC KBP 2015 Diagnostic Tri-Lingual EL Submitted Runs (Download here) (March 1, 2016)
• TAC KBP 2015 Tri-Lingual EDL Evaluation Summary Statistics (Download here) (October 27, 2015)
• LDC2015E103: TAC KBP 2015 Tri-Lingual Entity Discovery and Linking Evaluation Gold Standard Entity Mentions and Knowledge Base Links (Download here) (October 26, 2015)
• LDC2015E102: TAC KBP 2015 Tri-Lingual Entity Discovery and Linking Evaluation Queries V1.2 (Download here) (October 13, 2015)
• LDC2015E93: TAC KBP 2015 Tri-Lingual Entity Discovery and Linking Evaluation Source Corpus V2.0 (Download here) (October 15, 2015)
• LDC2015E75: TAC KBP 2015 Tri-lingual Entity Discovery and Linking Training Data V2.1 (Download from LDC) (October 15, 2015)
• LDC2015E72: TAC KBP 2015 Cold Start - Entity Discovery Sample Data (Download from LDC) (July 24, 2015)
• LDC2015E44: TAC KBP 2015 Tri-Lingual Entity Discovery and Linking Pilot Gold Standard Knowledge Base Links V1.1 (Download from LDC) (June 18, 2015)
• LDC2015E43: TAC KBP 2015 Tri-lingual Entity Discovery and Linking Knowledge Base Entries Creation Algorithm (Download from LDC) (May 6, 2015)
• LDC2015E42: TAC KBP 2015 Tri-lingual Entity Discovery and Linking Knowledge Base (Download from LDC) (May 6, 2015)
• LDC2015E61: TAC KBP 2015 Tri-Lingual Entity Discovery and Linking Pilot Source Corpus (Download from LDC) (April 27, 2015)


• Cold Start Track
• KBP 2015 Cold Start Slot Filling Evaluation Results (Download here) (March 31, 2016)
• LDC2015E100: TAC KBP 2015 English Cold Start Evaluation Assessment Results V3.0 (Download here) (November 12, 2015)
• LDC2015E81: TAC KBP 2015 English Cold Start Entity Discovery Evaluation Gold Standard Entity Mentions V1.2 (Download here) (October 26, 2015)
• TAC KBP 2015 Cold Start Evaluation Summary Statistics (Download here) (October 21, 2015)
• LDC2015E77: TAC KBP 2015 English Cold Start Evaluation Source Corpus V2.0 (Download README here and Corpus here) (August 18, 2015)
• LDC2015E72: TAC KBP 2015 Cold Start - Entity Discovery Sample Data (Download from LDC) (July 24, 2015)


• Slot Filler Validation Track
• LDC2015E100: TAC KBP 2015 English Cold Start Evaluation Assessment Results V3.0 (Download here) (November 5, 2015)
• TAC KBP 2015 Slot Filler Validation Evaluation Summary Statistics (Download here) (November 5, 2015)
• TAC 2015 KBP Slot Filler Validation Evaluation Input V1.1 (Download README here and Data here) (October 7, 2015)
• LDC2015E77: TAC KBP 2015 English Cold Start Evaluation Source Corpus V2.0 (Download README here and Corpus here) (August 18, 2015)
• TAC 2014 KBP Slot Filler Validation Evaluation Queries V1.1 (for system development in conjunction with 2014 assessments in LDC2015E46) (Download here) (July 10, 2015)
• TAC 2013 KBP Slot Filler Validation Evaluation Queries V1.2 (for system development in conjunction with 2013 assessments in LDC2015E46) (Download here) (July 10, 2015)


• Event Track
• LDC2015E101: TAC KBP 2015 English Event Argument Linking Evaluation Assessment Results V2.0 (Download here) (January 7, 2016)
• LDC2015R26: TAC KBP 2015 Event Nugget and Event Coreference Linking (Download here) (October 26, 2015)
• TAC KBP 2015 Event Nugget Evaluation Summary Statistics (Download here) (October 19, 2015)
• LDC2015E95: TAC KBP 2015 Event Nugget Annotation for Event Coreference (Download here) (September 22, 2015)
• LDC2015E94: TAC KBP 2015 Event Nugget and Event Coreference Linking Evaluation Source Corpus (Download README here and Corpus here) (September 8, 2015)
• TAC KBP 2015 English Event Argument Extraction Runs (Download here) (August 31, 2015)
• LDC2015E79: TAC KBP 2015 English Event Argument Linking Evaluation Source Corpus (Download README here and Corpus here) (August 17, 2015)
• LDC2015E73: TAC KBP 2015 Event Nugget Training Data Annotation V2 (Download from LDC) (August 17, 2015)
• LDC2015E41: TAC KBP 2015 English Event Argument Linking Training Data (Download from LDC) (April 27, 2015)