Zhiyi Song, Ann Bies, Stephanie Strassel, Teruko Mitamura, Hoa T. Dang, Joe Ellis, Sue Holm, Yakari Yamakawa
In this paper, we describe the event nugget annotation created in support of the pilot Event Nugget Detection evaluation in 2014 and in support of the Event Nugget Detection and TAC KBP open evaluation in 2015. We present the data volume for both training and eval data for the 2015 evaluation as well as changes to annotation in 2015 as compared to that of 2014. We also analyze the annotation for the 2015 evaluation as an example to show the annotation challenges and consistency, and identify the event types and subtypes that are most difficult for human annotators.
Proceedings of the 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation
June 17, 2016
San Diego, CA
The 4th Workshop on EVENTS: Definition, Detection, Coreference, and Representation