NIST logo
*
Bookmark and Share

NIST Open Machine Translation 2015 Evaluation (OpenMT15)

The NIST Open Machine Translation 2015 Evaluation (OpenMT15) will be implemented according to the OpenMT15 evaluation plan. It will take place in January 2015, followed by a workshop in April 2015.

Highlights

  • Evaluation on informal data genres (SMS/Chat, Conversational Telephone Speech) for Arabic-to-English and Chinese-to-English
  • Inclusion of audio input track
  • Explore common MT measurement techniques on these informal data genres

Documentation

Schedule

  • February 1, 2014: Initial evaluation plan available (will be updated periodically as more information is available)
  • February 1 - September 9, 2014: Registration period (early registration highly encouraged)
  • February - September 9, 2014: Training data available from LDC with incremental releases of new genres until end of May 2014
  • November 3 - 7, 2014: Dry run period
  • January 12 - 16, 2015: Main evaluation period for audio track; output due at NIST January 16, 11:59am ET
  • January 19 - 23, 2015: Main evaluation period for text track; output due at NIST January 19, 11:59am ET
  • January 31 - February 14, 2015: Human assessment period
  • April 2015 (TBD): Workshop in the Washington DC area
  • May 2015 (TBD): Official public release of results

Software and Resources

  • Coming soon

Contact

mt_poc@nist.gov

[ Main ]