Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Workshop Report: Test Methods and Metrics for Effective HRI in Real-World Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2020 (Virtual)

Published

Author(s)

Shelly Bagchi, Jeremy Marvel, Megan L. Zimmerman, Murat Aksu, Brian Antonishek

Abstract

This report details the second annual, full-day workshop exploring the metrology necessary for repeatably and independently assessing the performance of robotic systems in real-world human-robot interaction (HRI) scenarios. This workshop continues the motion toward bridging the gaps between the theory and applications of HRI, enabling reproducible studies in HRI, and accelerating the adoption of cutting edge technologies as the industry state-of-practice. The second annual workshop, 'Test Methods and Metrics for Effective HRI', seeks to identify test methods and metrics for the holistic assessment and assurance of HRI performance in practical applications. The focus is on identifying the key performance indicators of seemingly disparate sectors, and to foster the community based on the principles of transparency, repeatability and reproducibility, and establishing trust. The goal is to aid in the advancement of HRI technologies through the development of experimental design, test methods, and metrics for assessing HRI and interface designs.
Citation
NIST Interagency/Internal Report (NISTIR) - 8345
Report Number
8345

Keywords

human-robot interaction, workshop, metrics, test methods

Citation

Bagchi, S. , Marvel, J. , Zimmerman, M. , Aksu, M. and Antonishek, B. (2021), Workshop Report: Test Methods and Metrics for Effective HRI in Real-World Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2020 (Virtual), NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8345 (Accessed September 18, 2021)
Created February 7, 2021, Updated March 1, 2021