Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Guest Editorial Open Discussion of Robot Grasping Benchmarks, Protocols and Metrics



Jeffrey Mahler, Rob Platt, Alberto Rodriguez, Matei Ciocarlie, Aaron Dollar, Renaud Detry, Maximo Roa, Holly A. Yanco, Adam Norton, Joseph Falco, Karl Van Wyk, Elena R. Messina, Jurgen Leitner, Oliver Brock, Odhner Lael, Andrey Kurenkov, Matthew Matl, Ken Goldberg


Automated grasping has a long history of research that is increasing due to interest from industry. One Grand Challenge for robotics is Universal Picking: the ability to robustly grasp a broad variety of objects in diverse environments for applications from warehouses to assembly lines to homes. Although many researchers now openly share code and data, it is challenging to compare and/or reproduce experimental results to identify which aspects of which approaches work best due to variations in assumptions and experimental protocols, e.g., sensors, lighting, robot arms, grippers, and objects. This editorial discusses one possible metric for grasping, derived from industrial measures of performance: mean picks per minute.
IEEE Transactions on Automation Science and Engineering


robotic grasping, performance evaluation, benchmarking


Mahler, J. , Platt, R. , Rodriguez, A. , Ciocarlie, M. , Dollar, A. , Detry, R. , Roa, M. , Yanco, H. , Norton, A. , Falco, J. , Van Wyk, K. , Messina, E. , Leitner, J. , Brock, O. , Lael, O. , Kurenkov, A. , Matl, M. and Goldberg, K. (2018), Guest Editorial Open Discussion of Robot Grasping Benchmarks, Protocols and Metrics, IEEE Transactions on Automation Science and Engineering (Accessed June 16, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created October 14, 2018, Updated October 12, 2021