NIST to Hold June Workshop on AI Measurement and Evaluation

NIST will hold a virtual workshop on Artificial Intelligence Measurement and Evaluation (AIME) June 15-17, 2021. The three-day workshop aims to bring together stakeholders and experts to identify the most pressing needs for AI measurement and evaluation and to advance the state of the art and practice.

Executive Order 13859 directs NIST to advance underlying research for measuring and assessing AI technologies. That includes the development of AI data standards and best practices, as well as AI evaluation and testing methodologies and standards. NIST is working collaboratively with the private and public sectors to help prioritize and work on its AI activities.

The goals of the workshop are to:

• Identify
  1. the needs for and intended uses of AI measurement and evaluation
  2. the gaps in knowledge/practice preventing current AI measurement and evaluation activities from effectively meeting these needs/uses
• Solicit guidance on which specific areas NIST should focus its efforts 
• Identify specific users and applications in need of measurement and evaluation
• Collate best practices for AI measurement and evaluation
• Build community around AI measurement and evaluation: provide tools, resources, pointers to other sources, and continued engagement through periodic talks and seminars

Participants are requested to provide feedback on the read-ahead materials (overview document and TESTAIS presentation video recording) in order to help shape the program. These materials will be available in early June.

Workshop Website/Registration:

For details about the event, including the agenda, and to register, visit:
https://www.nist.gov/news-events/events/2021/06/ai-measurement-and-evaluation-workshop 

Please direct questions to:  aime-workshop [at] nist.gov (aime-workshop[at]nist[dot]gov)