Go to the NIST home page Go to the TAC Home Page TAC Banner

Overview
Call for papers
Submission
Important dates
Workshop program
Workshop proceedings
Organizers
Program committee
Contact


NAACL-HLT 2012
Workshop on Evaluation Metrics and System Comparison
for Automatic Summarization

Workshop Program
June 8, 2012

9:00–9:30 An Assessment of the Accuracy of Automatic Evaluation in Summarization
Karolina Owczarzak, John Conroy, Hoa Trang Dang and Ani Nenkova
9:30–10:00 Using the Omega Index for Evaluating Abstractive Community Detection
Gabriel Murray, Giuseppe Carenini and Raymond Ng
10:00–10:30 Machine Translation for Multilingual Summary Content Evaluation
Josef Steinberger and Marco Turchi
10:30–11:00 BREAK
11:00–11:40 Pilot task proposal: Summarization of scientific literature (Invited Talk)
Lucy Vanderwende and Anita de Waard
11:40–12:30 Discussion and planning for the pilot
12:30–2:30 LUNCH
2:30–3:30 Generation of Surveys of Research Areas (Invited Talk)
Drago Radev
3:30–4:00 BREAK
4:00–4:30 Ecological Validity and the Evaluation of Speech Summarization Quality
Anthony McCallum, Cosmin Munteanu, Gerald Penn and Xiaodan Zhu
4:30–5:00 The Heterogeneity Principle in Evaluation Measures for Automatic Summarization
Enrique Amigó, Julio Gonzalo and Felisa Verdejo
5:00–5:30 Discrepancy Between Automatic and Manual Evaluation of Summaries
Shamima Mithun, Leila Kosseim and Prasad Perera

NIST is an agency of the
U.S. Department of Commerce

privacy policy / security notice / accessibility statement
disclaimer
FOIA

Last updated: Wednesday, 24-Apr-2013 13:27:47 EDT
Comments to: tac-web@nist.gov