Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

DUC 2005: Evaluation of Question-Focused Summarization Systems

Published

Author(s)

Hoa T. Dang

Abstract

The Document Understanding Conference (DUC) 2005 evaluation had a single user-oriented, question-focused summarization task, which was to synthesize from a set of 25-50 documents a well-organized, fluent answer to a complex question. The evaluation shows that the best summarization systems have difficulty extracting relevant sentences in response to complex questions (as opposed to representative sentences that might be appropriate to a generic summary). The relatively generous allowance of 250 words for each answer also reveals how difficult it is for current summarization systems to produce fluent text from multiple documents.
Proceedings Title
Proceedings of the Workshop on Task-Focused Summarization and Question Answering
Conference Dates
July 23-24, 2006
Conference Location
Sydney, AS
Conference Title
Workshop on Task-Focused Summarization and Question Answering

Keywords

evaluation, information/knowledge management, question answering, summarization

Citation

Dang, H. (2007), DUC 2005: Evaluation of Question-Focused Summarization Systems, Proceedings of the Workshop on Task-Focused Summarization and Question Answering, Sydney, AS, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=50825 (Accessed July 26, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created January 22, 2007, Updated February 17, 2017