Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Event Nugget and Event Coreference Annotation

Published

Author(s)

Zhiyi Song, Ann Bies, Stephanie Strassel, Teruko Mitamura, Hoa T. Dang, Joe Ellis, Sue Holm, Yakari Yamakawa

Abstract

In this paper, we describe the event nugget annotation created in support of the pilot Event Nugget Detection evaluation in 2014 and in support of the Event Nugget Detection and TAC KBP open evaluation in 2015. We present the data volume for both training and eval data for the 2015 evaluation as well as changes to annotation in 2015 as compared to that of 2014. We also analyze the annotation for the 2015 evaluation as an example to show the annotation challenges and consistency, and identify the event types and subtypes that are most difficult for human annotators.
Proceedings Title
Proceedings of the 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation
Conference Dates
June 17, 2016
Conference Location
San Diego, CA, US
Conference Title
The 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation

Keywords

evaluation, natural language processing

Citation

Song, Z. , Bies, A. , Strassel, S. , Mitamura, T. , Dang, H. , Ellis, J. , Holm, S. and Yamakawa, Y. (2017), Event Nugget and Event Coreference Annotation, Proceedings of the 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation, San Diego, CA, US (Accessed December 12, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created June 16, 2017, Updated October 12, 2021