Workshop Report: Test Methods and Metrics for Effective HRI in Collaborative Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2019

Published

December 28, 2020

Author(s)

Shelly Bagchi, Murat Aksu, Megan L. Zimmerman, Jeremy Marvel, Brian Antonishek

Abstract

Verified and validated test methods, being necessary to measure the performance of complex systems, are important tools for driving innovation, benchmarking and improving performance, and establishing trust in collaborative human-robot teams. This full-day workshop aims to explore the metrology necessary for repeatably and independently assessing the collaborative performance of robotic systems in real-world human-robot interaction (HRI) scenarios. This workshop aims to bridge the gaps between the theory and applications of HRI in industry, accelerating the adoption of cutting edge technologies as the industry state-of-practice. The interest in collaborative HRI is evident in the current market as well as standards efforts toward manufacturing, social, medical, and service robot solutions. Though these domains have been considered separate for many years, recent technological and scientific advancements show that, while their applications may differ, the underlying principles of HRI performance impact each identically. As such, this workshop seeks to identify test methods and metrics for the holistic assessment and assurance of collaborative HRI performance. The focus is on identifying the key performance indicators of these seemingly disparate sectors, and additionally to establish a community based on the principles of transparency, repeatability, & establishing trust in the assessment of collaborative HRI. The goal is to aid in the advancement of HRI technologies through the development of experimental scenarios, protocols, test methods, & metrics for the verification and validation of interaction solutions and interface designs.

Citation

NIST Interagency/Internal Report (NISTIR) - 8339

Report Number

8339

NIST Pub Series

NIST Interagency/Internal Report (NISTIR)

Pub Type

NIST Pubs

Download Paper

DOI Link

Keywords

human-robot interaction, workshop, metrics, test methods

Citation

Bagchi, S. , Aksu, M. , Zimmerman, M. , Marvel, J. and Antonishek, B. (2020), Workshop Report: Test Methods and Metrics for Effective HRI in Collaborative Human-Robot Teams, ACM/IEEE Human-Robot Interaction Conference, 2019, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.8339 (Accessed April 20, 2024)