The Effects of Human Variation in DUC Summarization Evaluation

Published

July 1, 2004

Author(s)

Donna K. Harman, Paul D. Over

Abstract

There is a long history of research in automatic text summarization systems by both the text retrieval and the natural language processing communities, but evaluation of such systems' output has always presented problems. One critical problem remains how to handle the unavoidable variability in human judgments at the core of all the evaluations. Sponsored by

Proceedings Title

Proceedings of the Text Summarization Branches Out Workshop

Conference Dates

July 25-26, 2004

Conference Location

Barcelona, SP

Conference Title

Text Summarization Branches Out Workshop

Pub Type

Conferences

Keywords

DUC, evaluation, human variability, summarization

Citation

Harman, D. and Over, P. (2004), The Effects of Human Variation in DUC Summarization Evaluation, Proceedings of the Text Summarization Branches Out Workshop, Barcelona, SP (Accessed August 10, 2026)

Additional citation formats