Workshop Report: Novel and Emerging Test Methods and Metrics for Effective HRI, ACM/IEEE Conference on Human-Robot Interaction, 2021

Published

February 24, 2022

Author(s)

Shelly Bagchi, Jeremy Marvel, Megan Zimmerman, Murat Aksu, Brian Antonishek

Abstract

This report details the third annual, full-day workshop exploring the state-of-practice in the metrology necessary for repeatably and independently assessing the performance of robotic systems in real-world human-robot interaction (HRI) scenarios. This workshop continues the aims of shortening the lead time between the theory and applications of HRI, enabling reproducible studies, and accelerating the adoption of cutting-edge technologies as the industry state-of-practice. The workshop was held on March 12, 2021, as part of the virtual ACM/IEEE International Conference on Human-Robot Interaction. This third installment of the annual workshop, 'Test Methods and Metrics for Effective HRI,' seeks to identify novel and emerging test methods and metrics for the holistic assessment and assurance of HRI performance. The focus is on identifying innovative metrics and test methods for the evaluation of HRI performance, and to advance the growth of the HRI community based on the principles of collaboration, data sharing, and repeatability. The goal of this workshop is to aid in the advancement of HRI technologies through the development of experimental design, test methods, and metrics for assessing interaction and interface designs.

Citation

NIST Interagency/Internal Report (NISTIR) - 8417

Report Number

8417

NIST Pub Series

NIST Interagency/Internal Report (NISTIR)

Pub Type

NIST Pubs

Download Paper

https://doi.org/10.6028/NIST.IR.8417

Local Download

Keywords

human-robot interaction, workshop, metrics, test methods

Citation

Bagchi, S. , Marvel, J. , Zimmerman, M. , Aksu, M. and Antonishek, B. (2022), Workshop Report: Novel and Emerging Test Methods and Metrics for Effective HRI, ACM/IEEE Conference on Human-Robot Interaction, 2021, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8417, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=933646 (Accessed October 10, 2025)