Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Multimedia Language Technologies

We research and develop measurement and evaluation methods to advance and promote the use of technologies that provide more effective access to multimedia and multi-lingual information.

The group focuses on measurement and evaluation methods to facilitate the use of technologies that provide easier access to multimedia and multi-lingual information and that improve human-computer interface modalities. These technologies include recognizing and/or transforming information in speech, text, images, video, and other multimedia modalities, and the fusion of heterogeneous media content.  Focus areas include speech recognition, speaker recognition, language recognition, machine translation, image processing, image understanding, video processing, visual recognition, 2-D and 3D shape analysis, image quality assessment, and interoperable digital media access.

Projects and Programs

Content-Based Access to Unstructured Information

Ongoing
The goal of the project is to support the development of automatic systems that can provide content-based access to information that has not been explicitly structured for machine consumption. This support is in the form of evaluation infrastructure, since to quote Lord Kelvin, "If you can not

Data Science

Ongoing
Current MIG Data Science project activities DARPA D3M. NIST is supporting the DARPA D3M (Data-Driven Discoveries of Models) program as part of the Test and Evaluation (Government) Team. The D3M Program aims to allow automated systems with subject matter experts to model and solve complex machine

Interdisciplinary Projects

Ongoing
Current: DARPA CCU (Computational Cultural Understanding) ​ Past: IARPA MATERIAL (Machine Translation for English Retrieval of Information in Any Language) DARPA LORELEI (Low Resource Languages for Emergent Incidents) and LoReHLT (Low Resource Human Language Technologies) DARPA BOLT (Broad

Machine Translation

Ongoing
Current MT technology evaluation activities: OpenMT: A biannual NIST evaluation of text-to-text MT technology. Focus is placed on the core task of MT technology where information learned is applicable to other MT technology types. Past MT evaluation activities: LORELEI/LOREHLT, 2016-2019: Low

Publications

Awards

Contacts