Published: July 15, 2018
Karl Van Wyk, Joseph A. Falco, Elena R. Messina
The Robot Grasping and Manipulation Competition, held during the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in Daejeon, South Korea was sponsored by The IEEE Robotic and Automation Society (RAS) Technical Committee (TC) on Robotic Hands Grasping and Manipulation (RHGM) . Being the ﬁrst of a planned series of competitions in the area of grasping and manipulation, this competition is intended to be an ongoing event of progressing diﬃculty to spur technological developments and advance test methods and benchmarks that can be formalized for use by the community. The coupling of standardized performance testing with robot competitions will promote the use of unbiased evaluation methods to assess how well a robot system performs in a particular application space. We present a strategy for a grasping and manipulation competition that facilitates objective performance benchmarking of robotic assembly solutions. This strategy is based on test methods that can be used for more rigorous assessments and comparison of systems and components outside of the competition regime. While competitions have proven to be useful mechanisms for assessing the relative performance of robotic systems with measures of success, they often lack a methodical measurement science foundation. Consequently, scientiﬁcally sound and statistically signiﬁcant metrics, measurement, and evaluation methods to quantify performance are missing. Using performance measurement methods in a condensed format will accommodate competition time limits while introducing the methods to the community as tools for benchmarking performance in the developmental and deployment phases of a robot system. The particular evaluation methods presented here are focused on the mechanical assembly process, an application space that is expected to accelerate with the new robot technologies coming to market.
Citation: Robotic Grasping and Manipulation Competition
Publisher Info: Springer Science, New York, NY
Pub Type: Book Chapters
robot, grasping, manipulation, competition, benchmarks, performance measures, manufacturing
Created July 15, 2018, Updated November 10, 2018