Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Robotic Grasping and Manipulation Competition: Future Tasks to Support the Development of Assembly Robotics



Karl Van Wyk, Joseph A. Falco, Elena R. Messina


The Robot Grasping and Manipulation Competition, held during the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in Daejeon, South Korea was sponsored by The IEEE Robotic and Automation Society (RAS) Technical Committee (TC) on Robotic Hands Grasping and Manipulation (RHGM) [1]. Being the first of a planned series of competitions in the area of grasping and manipulation, this competition is intended to be an ongoing event of progressing difficulty to spur technological developments and advance test methods and benchmarks that can be formalized for use by the community. The coupling of standardized performance testing with robot competitions will promote the use of unbiased evaluation methods to assess how well a robot system performs in a particular application space. We present a strategy for a grasping and manipulation competition that facilitates objective performance benchmarking of robotic assembly solutions. This strategy is based on test methods that can be used for more rigorous assessments and comparison of systems and components outside of the competition regime. While competitions have proven to be useful mechanisms for assessing the relative performance of robotic systems with measures of success, they often lack a methodical measurement science foundation. Consequently, scientifically sound and statistically significant metrics, measurement, and evaluation methods to quantify performance are missing. Using performance measurement methods in a condensed format will accommodate competition time limits while introducing the methods to the community as tools for benchmarking performance in the developmental and deployment phases of a robot system. The particular evaluation methods presented here are focused on the mechanical assembly process, an application space that is expected to accelerate with the new robot technologies coming to market.
Robotic Grasping and Manipulation Competition
Publisher Info
Springer Science, New York, NY


robot, grasping, manipulation, competition, benchmarks, performance measures, manufacturing


Van, K. , Falco, J. and Messina, E. (2018), Robotic Grasping and Manipulation Competition: Future Tasks to Support the Development of Assembly Robotics, Robotic Grasping and Manipulation Competition, Springer Science, New York, NY, [online], (Accessed May 26, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 15, 2018, Updated November 10, 2018