NIST logo
*

NIST Open Machine Translation 2014 Evaluation (OpenMT14)

The NIST Open Machine Translation 2014 Evaluation (OpenMT14) will be implemented according to the OpenMT14 evaluation plan. It will take place in the Summer of 2014, followed by a Fall 2014 workshop.

Highlights

  • Evaluation on informal data genres (SMS/Chat, Conversational Telephone Speech) for Arabic-to-English and Chinese-to-English
  • Inclusion of audio input track
  • Explore common MT measurement techniques on these informal data genres

Documentation

Schedule

  • February 1, 2014: Initial evaluation plan available (will be updated periodically as more information is available)
  • February 1 - June 13, 2014: Registration period (early registration highly encouraged)
  • February - June 13, 2014: Training data available from LDC with incremental releases of new genres until end of May 2014
  • June 16 - 20, 2014: Dry run period
  • July 14 - 18, 2014: Main evaluation period for audio track; output due at NIST July 18, 11:59am ET
  • July 21 - 25, 2014: Main evaluation period for text track; output due at NIST July 25, 11:59am ET
  • August 4 - 15, 2014: Human assessment period
  • August 28 - 29, 2014: Workshop in the Washington DC area
  • September 9, 2014: Official public release of results

Software and Resources

  • Coming soon

Contact

mt_poc@nist.gov

[ Main ]