Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Multimodal Information Group

We research and develop measurement and evaluation methods to advance and promote the use of technologies that provide more effective access to multimedia and multi-lingual information.

The group focuses on measurement and evaluation methods to facilitate the use of technologies that provide easier access to multimedia and multi-lingual information and that improve human-computer interface modalities. These technologies include recognizing and/or transforming information in speech, text, images, video, and other multimedia modalities, and the fusion of heterogeneous media content.  Focus areas include speech recognition, speaker recognition, language recognition, machine translation, image processing, image understanding, video processing, visual recognition, 2-D and 3D shape analysis, image quality assessment, and interoperable digital media access.

Projects and Programs

Data Science

The NIST Information Access Division (IAD) initiated a Data Science Research Program (DSRP) aimed to advance the measurement science for big data and data

Interdisciplinary Projects

Some of the Multimodal Information Group's project areas span across multiple research areas within the group or to other groups in IAD. These interdisciplinary

Speech Analytics

The Multimodal Information Group's speech analytics program has a long history of activities supporting the development of technologies that extract content

Machine Translation

The Multimodal Information Group's machine translation (MT) program includes several activities contributing to machine translation technology and metrology

Publications

The 2019 NIST Speaker Recognition Evaluation CTS Challenge

Author(s)
Seyed Omid Sadjadi, Craig S. Greenberg, Elliot Singer, Douglas Reynolds, Lisa Mason, Jaime Hernandez-Cordero
In 2019, the U.S. National Institute of Standards and Technology (NIST) conducted a leaderboard style speaker recognition challenge using conversational

The 2019 NIST Audio-Visual Speaker Recognition Evaluation

Author(s)
Seyed Omid Sadjadi, Craig S. Greenberg, Elliot Singer, Douglas A. Reynolds, Lisa Mason, Jaime Hernandez-Cordero
In 2019, the U.S. National Institute of Standards and Technology (NIST) conducted the most recent in an ongoing series of speaker recognition evaluations (SRE)

Contacts