Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Standards and Performance Metrics for On-Road Autonomous Vehicles

To register for our 2023 Standards and Performance Metrics for On-Road Automated Vehicles Workshop: Visit


Workshop Summary

NIST Standards and Performance Metrics for On-Road Autonomous Vehicles Workshop Summary (PDF)

On-road autonomous vehicles are projected to influence key aspects of everyday life including transportation, goods delivery, manufacturing, public safety, and security. However, on-road autonomous vehicles can pose a risk in the event of unexpected system performance. NIST is a nonregulatory government agency under the Department of Commerce that is equipped to develop test methods, metrics, and standards to characterize the performance of these complex systems. Therefore, NIST is currently determining focus areas of interest to characterize the performance of autonomous vehicles to mitigate risk to manufacturers as well as consumers.

This workshop aims to solicit stakeholder feedback to identify key areas where NIST can develop standards and performance metrics to help advance the on-road autonomous vehicle field. In addition, this workshop aims to foster a multidisciplinary community consisting of stakeholders from a variety of disciplines and domains in autonomous vehicles. This workshop will be conducted virtually over 2 days consisting of introductory remarks, panels, breakout sessions, and concluding remarks.

Stay tuned for further announcements by subscribing to the NIST Autonomous Vehicles mailing list.

Pre-Workshop Reading

Summary Analysis of Fields of Interest Regarding Standards and Performance Metrics for On-Road Autonomous Vehicles (PDF)

Draft Agenda 

Day 1: Tuesday March 8, 2022 

(all times are Eastern Standard Time, UTC-5) 

Time Topic
9:00 AM - 9:30 AM   

Welcome to NIST 

James K. Olthoff, Performing the Non-Exclusive Functions and Duties of the Under Secretary of Commerce for Standards and Technology & Director, National Institute of Standards and Technology

Opening Remarks 

Nellie Abernathy, Department of Commerce

9:30 AM - 10:00 AM   

Keynote Speech 

Trent Victor, Waymo 

10:00 AM - 11:00 AM                                                                                                                                         

Panel 1: Safety 

For autonomous vehicles to be accepted, they must be trusted and perceived as safe systems. This panel discusses the requirements for testing conditions and evaluating safety of autonomous vehicles and the current state of Operation Design Domains (ODD). 

  • Ed Griffor, NIST (moderator)
  • Chan Lieu, Aurora 
  • Ed Straub, SAE
  • Jack Weast, Intel 
  • Bert Kaufman, Zoox
  • Robert Dingli, Plus
  • Robyn Robertson, Traffic Injury Research Foundation

Panel Organizer: Craig Schlenoff, craig.schlenoff [at] (craig[dot]schlenoff[at]nist[dot]gov)

11:00 AM -12:00 PM   

Lunch Break
12:00 PM - 1:00 PM   

Panel 2: Communication 

Quality communication protocols are critical in monitoring, messaging, and teleoperation of connected and autonomous vehicles. This panel discusses testing methods and messaging requirements for quality communication (both peer-to-peer and cellular) in on-road autonomous vehicles. 

  • Scott McCormick, Teleoperation Consortium (moderator)
  • John McNicol, British Standards Institute
  • Stan Schneider, Real-Time Innovations
  • Maarten Sierhuis, Nissan North America 
  • Fan Bai, General Motors
  • Bettina Erdem, Continental Corporation

Panel Organizer: Tao Zhang, tao.zhang [at] (tao[dot]zhang[at]nist[dot]gov)

1:00 PM - 2:00 PM   

Panel 3: Cybersecurity and Privacy

As vehicles become more connected and more automated functionalities are introduced, these complex systems must be secure and protect privacy while adhering to strict real-time quality constraints. This panel discusses standards and taxonomy in defining cybersecurity and privacy for on-road autonomous vehicles.

  • Katherine McClaskey, Cybersecurity and Infrastructure Security Agency (moderator) 

  • Adam Mistick, Ford

  • Anuja Sonalkar, Steer

  • Christos Papadopoulos, University of Memphis
  • Amie Stepanovich, Future of Privacy Forum

Panel Organizer: Suzanne Lightman, suzanne.lightman [at] (suzanne[dot]lightman[at]nist[dot]gov)

2:00 PM - 2:30 PM    Break
2:30 PM - 3:30 PM   

Panel 4: Artificial Intelligence 

Autonomous vehicles conduct a variety of automated cognition functions including lane following, path planning, and classification. This panel discusses metrics, datasets, and simulated/physical testing methods for evaluating artificial intelligence in on-road automated vehicles. 

  • Elham Tabassi, NIST (moderator)
  • Daniel Carruth, Mississippi State 
  • Alberto Lacaze, Robotic Research 
  • Hussein Mehanna, Cruise 

  • Alfred Chen, University of California Irvine 
  • Vijay Patnaik, Applied Intuition
  • Kevin Zaseck, Toyota Research Institute 

Panel Organizer: Vinh Nguyen, vinh.t.nguyen [at] (vinh[dot]t[dot]nguyen[at]nist[dot]gov)

3:30 PM - 4:30 PM   

Panel 5: Sensor Perception 

The driving environment consists of multiple obstacles to perception (both manual and automated) including occlusion, variable reflectivity, and edge cases. This panel discusses testing conditions and metrics for evaluating sensor data and fusion techniques in autonomous vehicles. 

  • Kamel Saidi, NIST (moderator)
  • William Buller, Michigan Tech Research Institute 
  • Rajeev Thakur, Velodyne
  • Brent Fisher, Auto Lidar Expert
  • Ryan Lamm, Southwest Research Institute
  • Zeb Barber, Aurora 

Panel Organizer: Prem Rachakonda, prem.rachakonda [at] (prem[dot]rachakonda[at]nist[dot]gov)

4:30 PM - 5:00 PM    Closing Remarks
5:00 PM    Adjourn for the day.

Day 2: Wednesday March 9, 2022 

(all times are Eastern Standard Time, UTC-5) 

Time Topic
10:00 AM - 10:30 AM

Day 2 Opening

Tim Kurth, Chief Counsel (R), United States House of Representatives, Energy and Commerce Committee Consumer Protection and Commerce Subcommittee 

Recap of Day 1

10:30 AM- 11:00 AM

Keynote Speech: Adam Campbell, Gatik

11:00 AM - 12:30 PM

Breakout Session 1

Breakout Rooms/Topic Areas:

  • Safety 
  • Communication
  • Artificial Intelligence
  • Cybersecurity
  • Sensor Perception  


12:30 PM - 1:30 PM

Lunch Break

1:30 PM - 3:00 PM

Breakout Session 2

Breakout Rooms/Topic Areas:

  • Safety 
  • Communication
  • Artificial Intelligence
  • Cybersecurity
  • Sensor Perception  
3:00 PM - 3:30 PM Break
3:30 PM - 5:00 PM

Breakout Debrief

Breakout facilitators will host a panel to discuss findings. 

Closing Remarks  

5:00 PM Adjourn. 
Created December 15, 2021, Updated May 24, 2023