Go to the NIST home page Go to the TAC Home Page TAC Banner

Call for papers
Important dates
Workshop program
Workshop proceedings
Program committee

Workshop on Evaluation Metrics and System Comparison
for Automatic Summarization

Workshop Program
June 8, 2012

9:00–9:30 An Assessment of the Accuracy of Automatic Evaluation in Summarization
Karolina Owczarzak, John Conroy, Hoa Trang Dang and Ani Nenkova
9:30–10:00 Using the Omega Index for Evaluating Abstractive Community Detection
Gabriel Murray, Giuseppe Carenini and Raymond Ng
10:00–10:30 Machine Translation for Multilingual Summary Content Evaluation
Josef Steinberger and Marco Turchi
10:30–11:00 BREAK
11:00–11:40 Pilot task proposal: Summarization of scientific literature (Invited Talk)
Lucy Vanderwende and Anita de Waard
11:40–12:30 Discussion and planning for the pilot
12:30–2:30 LUNCH
2:30–3:30 Generation of Surveys of Research Areas (Invited Talk)
Drago Radev
3:30–4:00 BREAK
4:00–4:30 Ecological Validity and the Evaluation of Speech Summarization Quality
Anthony McCallum, Cosmin Munteanu, Gerald Penn and Xiaodan Zhu
4:30–5:00 The Heterogeneity Principle in Evaluation Measures for Automatic Summarization
Enrique Amigó, Julio Gonzalo and Felisa Verdejo
5:00–5:30 Discrepancy Between Automatic and Manual Evaluation of Summaries
Shamima Mithun, Leila Kosseim and Prasad Perera

NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement

Last updated: Wednesday, 24-Apr-2013 17:27:47 UTC
Comments to: tac-web@nist.gov