Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
To register for our 2023 Standards and Performance Metrics for On-Road Automated Vehicles Workshop: Visit https://www.nist.gov/news-events/events/2023/09/standards-and-performance-metrics-road-automated-vehicles-workshop
Workshop Summary
NIST Standards and Performance Metrics for On-Road Autonomous Vehicles Workshop Summary (PDF)
On-road autonomous vehicles are projected to influence key aspects of everyday life including transportation, goods delivery, manufacturing, public safety, and security. However, on-road autonomous vehicles can pose a risk in the event of unexpected system performance. NIST is a nonregulatory government agency under the Department of Commerce that is equipped to develop test methods, metrics, and standards to characterize the performance of these complex systems. Therefore, NIST is currently determining focus areas of interest to characterize the performance of autonomous vehicles to mitigate risk to manufacturers as well as consumers.
This workshop aims to solicit stakeholder feedback to identify key areas where NIST can develop standards and performance metrics to help advance the on-road autonomous vehicle field. In addition, this workshop aims to foster a multidisciplinary community consisting of stakeholders from a variety of disciplines and domains in autonomous vehicles. This workshop will be conducted virtually over 2 days consisting of introductory remarks, panels, breakout sessions, and concluding remarks.
Stay tuned for further announcements by subscribing to the NIST Autonomous Vehicles mailing list.
Pre-Workshop Reading
Summary Analysis of Fields of Interest Regarding Standards and Performance Metrics for On-Road Autonomous Vehicles (PDF)
Draft Agenda
Day 1: Tuesday March 8, 2022
(all times are Eastern Standard Time, UTC-5)
| Time | Topic |
|---|---|
| 9:00 AM - 9:30 AM |
Welcome to NIST James K. Olthoff, Performing the Non-Exclusive Functions and Duties of the Under Secretary of Commerce for Standards and Technology & Director, National Institute of Standards and Technology Opening Remarks Nellie Abernathy, Department of Commerce |
| 9:30 AM - 10:00 AM |
Keynote Speech Trent Victor, Waymo |
| 10:00 AM - 11:00 AM |
Panel 1: Safety For autonomous vehicles to be accepted, they must be trusted and perceived as safe systems. This panel discusses the requirements for testing conditions and evaluating safety of autonomous vehicles and the current state of Operation Design Domains (ODD).
Panel Organizer: Craig Schlenoff, craig.schlenoff [at] nist.gov (craig[dot]schlenoff[at]nist[dot]gov) |
|
11:00 AM -12:00 PM |
Lunch Break |
| 12:00 PM - 1:00 PM |
Panel 2: Communication Quality communication protocols are critical in monitoring, messaging, and teleoperation of connected and autonomous vehicles. This panel discusses testing methods and messaging requirements for quality communication (both peer-to-peer and cellular) in on-road autonomous vehicles.
Panel Organizer: Tao Zhang, tao.zhang [at] nist.gov (tao[dot]zhang[at]nist[dot]gov) |
| 1:00 PM - 2:00 PM |
Panel 3: Cybersecurity and Privacy As vehicles become more connected and more automated functionalities are introduced, these complex systems must be secure and protect privacy while adhering to strict real-time quality constraints. This panel discusses standards and taxonomy in defining cybersecurity and privacy for on-road autonomous vehicles.
Panel Organizer: Suzanne Lightman, suzanne.lightman [at] nist.gov (suzanne[dot]lightman[at]nist[dot]gov) |
| 2:00 PM - 2:30 PM | Break |
| 2:30 PM - 3:30 PM |
Panel 4: Artificial Intelligence Autonomous vehicles conduct a variety of automated cognition functions including lane following, path planning, and classification. This panel discusses metrics, datasets, and simulated/physical testing methods for evaluating artificial intelligence in on-road automated vehicles.
Panel Organizer: Vinh Nguyen, vinh.t.nguyen [at] nist.gov (vinh[dot]t[dot]nguyen[at]nist[dot]gov) |
| 3:30 PM - 4:30 PM |
Panel 5: Sensor Perception The driving environment consists of multiple obstacles to perception (both manual and automated) including occlusion, variable reflectivity, and edge cases. This panel discusses testing conditions and metrics for evaluating sensor data and fusion techniques in autonomous vehicles.
Panel Organizer: Prem Rachakonda, prem.rachakonda [at] nist.gov (prem[dot]rachakonda[at]nist[dot]gov) |
| 4:30 PM - 5:00 PM | Closing Remarks |
| 5:00 PM | Adjourn for the day. |
Day 2: Wednesday March 9, 2022
(all times are Eastern Standard Time, UTC-5)
| Time | Topic |
|---|---|
| 10:00 AM - 10:30 AM |
Day 2 Opening Tim Kurth, Chief Counsel (R), United States House of Representatives, Energy and Commerce Committee Consumer Protection and Commerce Subcommittee Recap of Day 1 |
|
10:30 AM- 11:00 AM |
Keynote Speech: Adam Campbell, Gatik |
| 11:00 AM - 12:30 PM |
Breakout Session 1 Breakout Rooms/Topic Areas:
|
| 12:30 PM - 1:30 PM |
Lunch Break |
| 1:30 PM - 3:00 PM |
Breakout Session 2 Breakout Rooms/Topic Areas:
|
| 3:00 PM - 3:30 PM | Break |
| 3:30 PM - 5:00 PM |
Breakout Debrief Breakout facilitators will host a panel to discuss findings. Closing Remarks |
| 5:00 PM | Adjourn. |