NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Workshop Report: Test Methods and Metrics for Effective HRI in Real-World Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2020 (Virtual)

Published

Author(s)

Shelly Bagchi, Jeremy Marvel, Megan L. Zimmerman, Murat Aksu, Brian Antonishek

Abstract

This report details the second annual, full-day workshop exploring the metrology necessary for repeatably and independently assessing the performance of robotic systems in real-world human-robot interaction (HRI) scenarios. This workshop continues the motion toward bridging the gaps between the theory and applications of HRI, enabling reproducible studies in HRI, and accelerating the adoption of cutting edge technologies as the industry state-of-practice. The second annual workshop, 'Test Methods and Metrics for Effective HRI', seeks to identify test methods and metrics for the holistic assessment and assurance of HRI performance in practical applications. The focus is on identifying the key performance indicators of seemingly disparate sectors, and to foster the community based on the principles of transparency, repeatability and reproducibility, and establishing trust. The goal is to aid in the advancement of HRI technologies through the development of experimental design, test methods, and metrics for assessing HRI and interface designs.
Citation
NIST Interagency/Internal Report (NISTIR) - 8345
Report Number
8345
NIST Pub Series
NIST Interagency/Internal Report (NISTIR)
Pub Type
NIST Pubs

Download Paper

https://doi.org/10.6028/NIST.IR.8345
Local Download

Keywords

human-robot interaction, workshop, metrics, test methods
Robotics, Metric and Collaborative robots

Citation

Bagchi, S. , Marvel, J. , Zimmerman, M. , Aksu, M. and Antonishek, B. (2021), Workshop Report: Test Methods and Metrics for Effective HRI in Real-World Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2020 (Virtual), NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8345 (Accessed November 5, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created February 7, 2021, Updated March 1, 2021
Was this page helpful?