An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
DUC 2005: Evaluation of Question-Focused Summarization Systems
Published
Author(s)
Hoa T. Dang
Abstract
The Document Understanding Conference (DUC) 2005 evaluation had a single user-oriented, question-focused summarization task, which was to synthesize from a set of 25-50 documents a well-organized, fluent answer to a complex question. The evaluation shows that the best summarization systems have difficulty extracting relevant sentences in response to complex questions (as opposed to representative sentences that might be appropriate to a generic summary). The relatively generous allowance of 250 words for each answer also reveals how difficult it is for current summarization systems to produce fluent text from multiple documents.
Proceedings Title
Proceedings of the Workshop on Task-Focused Summarization and Question Answering
Conference Dates
July 23-24, 2006
Conference Location
Sydney, AS
Conference Title
Workshop on Task-Focused Summarization and Question Answering
Dang, H.
(2007),
DUC 2005: Evaluation of Question-Focused Summarization Systems, Proceedings of the Workshop on Task-Focused Summarization and Question Answering, Sydney, AS, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=50825
(Accessed February 18, 2025)