Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Multimedia Language Technologies Group

We research and develop measurement and evaluation methods to advance and promote the use of technologies that provide more effective access to multimedia and multi-lingual information.

The Multimedia Language Technologies Group (MLTG), established in the 1980s as the Speech Group, has a long history of conducting extensive benchmark testing in human language technology. Our current name reflects the significant growth and complexity of our evaluation portfolio over the decades. MLTG focuses on developing measurement and evaluation methods that facilitate easier access to multilingual and multimedia information while improving human-computer interaction.

Our expertise includes recognizing and transforming information across various modalities—such as speech, text, images, and video—and the fusion of heterogeneous media content. Key focus areas include:

  • Speech & Language: Speech, speaker, and language recognition, machine translation, and information retrieval.
  • Visuals & Video: Image and video processing, visual recognition, and 2D/3D shape analysis.
  • Systems & Quality: Image quality assessment and interoperable digital media access.

Projects and Programs

Content-Based Access to Unstructured Information

Ongoing
The goal of the project is to support the development of automatic systems that can provide content-based access to information that has not been explicitly structured for machine consumption. This support is in the form of evaluation infrastructure, since to quote Lord Kelvin, "If you can not...

Data Science

Ongoing
Current MIG Data Science project activities DARPA D3M. NIST is supporting the DARPA D3M (Data-Driven Discoveries of Models) program as part of the Test and Evaluation (Government) Team. The D3M Program aims to allow automated systems with subject matter experts to model and solve complex machine...

Interdisciplinary Projects

Ongoing
Current: DARPA CCU (Computational Cultural Understanding) ​ Past: IARPA MATERIAL (Machine Translation for English Retrieval of Information in Any Language) DARPA LORELEI (Low Resource Languages for Emergent Incidents) and LoReHLT (Low Resource Human Language Technologies) DARPA BOLT (Broad...

Machine Translation

Ongoing
Current MT technology evaluation activities: OpenMT: A biannual NIST evaluation of text-to-text MT technology. Focus is placed on the core task of MT technology where information learned is applicable to other MT technology types. Past MT evaluation activities: LORELEI/LOREHLT, 2016-2019: Low...

Publications

2025 NIST GenAI Text Challenge Evaluation Plan

Author(s)
Seungmin Seo, Hariharan Iyer, Yooyoung Lee
The NIST Generative AI (GenAI) Text Challenge is an evaluation program designed to probe the capabilities and limitations of generative AI models from three...

2025 NIST GenAI (Pilot): Code Challenge Evaluation Plan

Author(s)
Peter Fontana, Yooyoung Lee, Hariharan Iyer, Sonika Sharma
We are launching a pilot for measuring and evaluating unit tests generated by Artificial Intelligence (AI) for testing elementary python code. This pilot will...

Awards

Ellen Voorhees receives Gerald Salton Award

Congratulations to Ellen Voorhees on receiving the Gerard Salton Award at the ACM Conference on Research and Development in Information Retrieval (SIGIR). The Gerard Salton Award is presented every three years to an individual who has made “...

Ellen Voorhees Wins Ron Brown Excellence in Innovation Award

Dr. Ellen M. Voorhees was announced as the recipient of the Ron Brown Excellence Award in Innovation as part of the 73rd Annual Department of Commerce award winners. The Secretary of Commerce noted that "former Secretary of Commerce Ron Brown saw...

Contacts

Was this page helpful?