TAC KBP 2014
The Text Analysis Conference (TAC) is organized by the U.S. National Institute of Standards and Technology (NIST). It was initiated in 2008 and developed out of NIST's Text REtrieval Conference (TREC) and Document Understanding Conference (DUC). TAC's mission is to support research within the Natural Language Processing community by providing the infrastructure necessary for large-scale evaluation of NLP methodologies. TAC's primary purpose is not competitive benchmarking; rather, the emphasis is on advancing the state of the art through evaluation results.
A TAC cycle consists of a set tracks, areas of focus in which particular NLP tasks are defined. NIST distributes test data for each track; participants run their NLP systems on the data and return their results to NIST; NIST then pools the individual results, judges them for correctness, and evaluates the results. The TAC cycle culminates with a workshop that is a forum for participants to discuss their work and plan future tasks and evaluations.
This volume constitutes the Proceedings of the Second Text Analysis Conference (TAC 2009). The TAC 2009 workshop was held in Gaithersburg, Maryland, November 16-17, 2009. TAC 2009 brings together three tracks - Knowledge Base Population (KBP), Recognizing Textual Entailment (RTE), and Summarization. Sixty teams submitted results to one or more of the TAC 2009 tracks. The teams represented both universities and companies and were based in 19 different countries and six continents, with the greatest participation from North America (21), Asia (18), and Europe (15).
The TAC 2009 workshop includes plenary talks, a poster/demo session, and discussion and planning sessions for TAC 2010. Participants may sometimes cite specific vendors and commercial products, but the inclusion or omission of a particular company or product implies neither endorsement nor criticsm by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own words and do not necessarily reflect those of the sponsors.
TAC 2009 is sponsored by NIST and the U.S. Department of Defense, with additional support for the RTE track from the PASCAL-2 Network of Excellence. Their sponsorship is gratefully acknowledged, as is the invaluable contribution of the TAC 2009 advisory committee, track organizers, and track participants.
TAC 2009 Advisory Committee
John Conroy, IDA/CCS
Ido Dagan, Bar Ilan University
Hoa Trang Dang, NIST (chair)
Maarten de Rijke, University of Amsterdam
Bill Dolan, Microsoft Research
Bonnie Dorr, University of Maryland
Donna Harman, NIST
Andy Hickl, Language Computer Corporation
Ed Hovy, ISI/USC
Bernardo Magnini, FBK
Ani Nenkova, University of Pennsylvania
Drago Radev, University of Michigan
Lucy Vanderwende, Microsoft Research
Ellen Voorhees, NIST
Ralph Weischedel, BBN