Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Guest Editorial Open Discussion of Robot Grasping Benchmarks, Protocols and Metrics

Published

Author(s)

Jeffrey Mahler, Rob Platt, Alberto Rodriguez, Matei Ciocarlie, Aaron Dollar, Renaud Detry, Maximo Roa, Holly A. Yanco, Adam Norton, Joseph Falco, Karl Van Wyk, Elena R. Messina, Jurgen Leitner, Oliver Brock, Odhner Lael, Andrey Kurenkov, Matthew Matl, Ken Goldberg

Abstract

Automated grasping has a long history of research that is increasing due to interest from industry. One Grand Challenge for robotics is Universal Picking: the ability to robustly grasp a broad variety of objects in diverse environments for applications from warehouses to assembly lines to homes. Although many researchers now openly share code and data, it is challenging to compare and/or reproduce experimental results to identify which aspects of which approaches work best due to variations in assumptions and experimental protocols, e.g., sensors, lighting, robot arms, grippers, and objects. This editorial discusses one possible metric for grasping, derived from industrial measures of performance: mean picks per minute.
Citation
IEEE Transactions on Automation Science and Engineering
Volume
15
Issue
4

Keywords

robotic grasping, performance evaluation, benchmarking

Citation

Mahler, J. , Platt, R. , Rodriguez, A. , Ciocarlie, M. , Dollar, A. , Detry, R. , Roa, M. , Yanco, H. , Norton, A. , Falco, J. , Van Wyk, K. , Messina, E. , Leitner, J. , Brock, O. , Lael, O. , Kurenkov, A. , Matl, M. and Goldberg, K. (2018), Guest Editorial Open Discussion of Robot Grasping Benchmarks, Protocols and Metrics, IEEE Transactions on Automation Science and Engineering (Accessed October 11, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 14, 2018, Updated October 12, 2021