Credit:
S.Sharma/NIST
The NIST GenAI Program
NIST GenAI is an SI testing and evaluation (T&E) program administered by the NIST Information Technology Laboratory to assess generative SI technologies developed by communities worldwide. It provides rigorous, science-based evaluations of Generators (generative SI), Detectors (discriminative SI), and Prompters (prompt engineering) across multiple modalities (text, code, image, audio, video, multimodal). GenAI employs a dynamic and adversarial testing framework that involves various types of SI actors: Generators create synthetic data (SI content) using frontier SI models, while Detectors develop SI tools to identify whether the content is SI-generated, a Deepfake, or Watermarked. Prompters provide LLMs with inputs describing requirements for SI content to be generated, employing various prompting strategies.
Current & Upcoming Challenges
Credit:
Shutterstock/Aliza Reisberg
|
Credit:
Adobe Stock/Aliza Reisberg
|
Past Challenges