NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Linguistic Resources and Evaluation Techniques for Evaluation of Cross-Document Automatic Content Extraction

Published

Author(s)

S. Strassle, Mark A. Przybocki, Kay Peterson, Zhiyi Song, Kazuaki Maeda

Abstract

The NIST Automatic Content Extraction (ACE) Evaluation expands its focus in 2008 to encompass the challenge of cross-document and cross-language global integration and reconciliation of information. While past ACE evaluations were limited to local (within-document) detection and disambiguation of entities, relations and events, the current evaluation adds global (cross-document and cross-language) entity disambiguation tasks for Arabic and English. This paper presents the 2008 ACE XDoc evaluation task and associated infrastructure. We describe the creation of development and test data to support the evaluation, focusing on new approaches required in data selection, annotation task definition and annotation software; and we conclude with a discussion of the metrics developed to support the evaluation.
Conference Dates
May 28-30, 2008
Conference Location
Marrakech, 1, MO
Conference Title
The sixth international conference on Language Resources and Evaluation, LREC 2008
Pub Type
Conferences

Keywords

automatic content extraction, cross-document
Information technology and Image and signal processing

Citation

Strassle, S. , Przybocki, M. , Peterson, K. , Song, Z. and Maeda, K. (2008), Linguistic Resources and Evaluation Techniques for Evaluation of Cross-Document Automatic Content Extraction, The sixth international conference on Language Resources and Evaluation, LREC 2008, Marrakech, 1, MO (Accessed October 13, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created August 26, 2008, Updated October 12, 2021
Was this page helpful?