KBP 2013 Home
TAC KBP 2013 Sentiment Slot Filling Track
The overall goal of the Sentiment Slot Filling track is to assess the quality of detectors for scoped and attributed sentiment. This track will supplement existing Entity Linking, Slot Filling, and Cold Start tasks with information about opinions held by people and other entities. The task will be constrained in 2013 to address only positive and negative evaluative sentiment, attributed to a KBP entity, and held about another KBP entity.
The document collection is expected to be primarily blogs with discussion posts, although news articles may also be included. Documents will be formatted in the same way as the documents for the other Knowledge Base Population tracks.
The task is for systems to find all cases where the query entity (sentiment holder) is documented as holding a positive or negative sentiment about another entity (sentiment target). The sentiment slot filling task is a special case of slot filling in which the slots indicate that the query entity has expressed either a positive or negative sentiment toward the entity that is the slot filler. Alternatively, the slots may indicate that the query entity is the target of either a positive or negative sentiment expressed by the slot filler. The slot names in 2013 are limited to the following four sentiment types:
Input and output format and requirements for the sentiment slot filling task are the same as for the English slot filling task, except that slots for the sentiment task are limited to the four sentiment types defined above. In addition to identifying positive and negative sentiment between two KBP entities, systems must be able detect when two entity mentions refer to the same entity, so as to avoid returning redundant slot fillers for a given query entity and sentiment slot. Evaluation will be on slot filler P/R/F1, as for the Engish slot filling task.
Track CoordinatorMargaret Mitchell (Johns Hopkins University, firstname.lastname@example.org)
NIST is an agency of the
U.S. Department of Commerce
Last updated: Friday, 24-Jan-2014 14:01:37 EST
Comments to: email@example.com