U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting

Published

Author(s)

Shelly Bagchi, Patrick Holthaus, Gloria Beraldo, Emmanuel Senft, Daniel Hernandez Garcia, Zhao Han, Suresh Kumaar Jayaraman, Alessandra Rossi, Connor Esterwood, Antonio Andriella, Paul Pridham

Abstract

In this paper, we present a proposed format for reporting human studies in Human-Robot Interaction (HRI). We specifically call out details which are often overlooked or left out of conference and journal papers due to space constraints, and propose a standardized format to contain those details in paper appendices. We expect that providing a formalized study reporting method will promote an increase in replicability and reproducibility of HRI studies, and encourage meta-analysis and review, ultimately increasing the generalizability and validity of HRI research. We consider our draft the first step towards these goals, and we release it to solicit feedback from the HRI community on the included topics.
Proceedings Title
Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
Conference Dates
March 13-16, 2023
Conference Location
Stockholm, SE
Conference Title
2023 ACM/IEEE International Conference on Human-Robot Interaction
Pub Type
Conferences

Download Paper

https://doi.org/10.1145/3568294.3580162
Local Download

Keywords

human-robot interaction, human studies, reporting, appendices, replicability, reproducibility, standards
Usability and human factors, Standards education, Reference materials, Reference instruments, Information technology, Frameworks and Collaborative robots

Citation

Bagchi, S. , Holthaus, P. , Beraldo, G. , Senft, E. , Hernandez Garcia, D. , Han, Z. , Jayaraman, S. , Rossi, A. , Esterwood, C. , Andriella, A. and Pridham, P. (2023), Towards Improved Replicability of Human Studies in Human-Robot Interaction: Recommendations for Formalized Reporting, Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, Stockholm, SE, [online], https://doi.org/10.1145/3568294.3580162, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=936040 (Accessed April 29, 2024)

Created March 13, 2023, Updated June 7, 2023