Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Standards and Performance Metrics for On-Road Autonomous Vehicles

Standards and Performance Metrics March 8-9
Credit: Zapp2Photo/Shutterstock

On-road autonomous vehicles are projected to influence key aspects of everyday life including transportation, goods delivery, manufacturing, public safety, and security. However, on-road autonomous vehicles can pose a risk in the event of unexpected system performance. NIST is a nonregulatory government agency under the Department of Commerce that is equipped to develop test methods, metrics, and standards to characterize the performance of these complex systems. Therefore, NIST is currently determining focus areas of interest to characterize the performance of autonomous vehicles to mitigate risk to manufacturers as well as consumers.

This workshop aims to solicit stakeholder feedback to identify key areas where NIST can develop standards and performance metrics to help advance the on-road autonomous vehicle field. In addition, this workshop aims to foster a multidisciplinary community consisting of stakeholders from a variety of disciplines and domains in autonomous vehicles. This workshop will be conducted virtually over 2 days consisting of introductory remarks, panels, breakout sessions, and concluding remarks.

Stay tuned for further announcements by subscribing to the NIST Autonomous Vehicles mailing list.

 

Draft Agenda 

Day 1: Tuesday March 8, 2022 

(all times are Eastern Standard Time, UTC-5) 

Time Topic
9:00 AM - 9:30 AM   

Welcome to NIST 

Opening Remarks 

9:30 AM - 10:00 AM    Keynote Speech 
10:00 AM - 11:00 AM                                                                                                                                         

Panel 1: Safety 

For autonomous vehicles to be accepted, they must be trusted and perceived as safe systems. This panel discusses the requirements for testing conditions and evaluating safety of autonomous vehicles and the current state of Operation Design Domains (ODD). 

11:00 AM -12:00 PM   

Lunch Break
12:00 PM - 1:00 PM   

Panel 2: Communication 

Quality communication protocols are critical in monitoring, messaging, and teleoperation of connected and autonomous vehicles. This panel discusses testing methods and messaging requirements for quality communication (both peer-to-peer and cellular) in on-road autonomous vehicles. 

1:00 PM - 2:00 PM   

Panel 3: Cybersecurity 

As vehicles become more connected and more automated functionalities are introduced, these complex systems must be secure while adhering to strict real-time quality constraints. This panel discusses standards and taxonomy in defining cybersecurity of on-road autonomous vehicles. 

2:00 PM - 2:30 PM    Break
2:30 PM - 3:30 PM   

Panel 4: Artificial Intelligence 

Autonomous vehicles conduct a variety of automated cognition functions including lane following, path planning, and classification. This panel discusses metrics, datasets, and simulated/physical testing methods for evaluating artificial intelligence in on-road automated vehicles. 

3:30 PM - 4:30 PM   

Panel 5: Sensor Perception 

The driving environment consists of multiple obstacles to perception (both manual and automated) including occlusion, variable reflectivity, and edge cases. This panel discusses testing conditions and metrics for evaluating sensor data and fusion techniques in autonomous vehicles. 

4:30 PM - 5:00 PM    Closing Remarks
5:00 PM    Adjourn for the day.

Day 2: Wednesday March 9, 2022 

(all times are Eastern Standard Time, UTC-5) 

Time Topic
10:00 AM - 10:30 AM Recap and Opening
10:30 AM - 11:00 AM Keynote Speech
11:00 AM - 12:30 PM

Breakout Session 1

Breakout Rooms/Topic Areas:

  • Safety 
  • Communication
  • Artificial Intelligence
  • Cybersecurity
  • Sensor Perception  

 

12:30 PM - 1:30 PM

Lunch Break

1:30 PM - 3:00 PM

Breakout Session 2

Breakout Rooms/Topic Areas:

  • Safety 
  • Communication
  • Artificial Intelligence
  • Cybersecurity
  • Sensor Perception  
3:00 PM - 5:00 PM

Breakout Debrief

Breakout facilitators will host a panel to discuss findings. 

Closing Remarks  

5:00 PM Adjourn. 
Created December 15, 2021, Updated January 10, 2022