NIST Metrics for Machine Translation Challenge (MetricsMATR)

Information Technology Lab, Information Access Division

NIST: National Institute of Standards and Technology

Speech Group Home

Benchmark Tests

NIST MetricsMATR08

MetricsMATR08 is the first NIST MetricsMATR challenge. It takes place in the spring/summer of 2008 and is implemented in accordance with the NIST MetricsMATR08 Evaluation Plan. Please explore the plan in Documentation if you would like to participate. MetricsMATR08 concludes with a workshop at AMTA 2008.

Documentation

Joining the NIST Open MT Evaluation Community

You can subscribe to the MetricsMATR mailing list hosted by NIST, metricsmt_list@nist.gov, by sending e-mail to listproc@nist.gov. Include "subscribe metricsmt_list" in the body.

Tentative schedule:

Mar 31 2008	Development data set released
Aug 01 2008	Deadline for participation commitment
Aug 01 2008 - Sep 05 2008	Metric submission period
Sep 05 2008	Deadline for metric software to be installed and operational at NIST
Sep 30 2008	Paper describing submitted metric(s) due at NIST
Oct 25 2008	AMTA 2008 workshop: MetricsMATR

[ MetricsMATR Home ]

Page Created: January 29, 2008
Last Updated: April 16, 2008

Speech Group is part of IAD and ITL
NIST is an agency of the U.S. Department of Commerce