NIST logo

Publication Citation: Evaluation of RoboCup Maps

NIST Authors in Bold

Author(s): Stephen B. Balakirsky; Benjamin Balaguer; S Carpin; Arnoud Visser;
Title: Evaluation of RoboCup Maps
Published: December 17, 2009
Abstract: This paper describes the steps taken to create the score criteria aimed at measuring the quality of maps produced by teams participating in the RoboCup Rescue Virtual Robots competition. Since metrics have already been developed by a few research groups, we start by highlighting the most popular solutions to this problem, emphasizing their strengths and weaknesses. Having put the difficulty of creating map benchmarks into perspective, we present our map benchmark suite, appropriate for Urban Search and Rescue missions, along with examples taken from former competitions.
Proceedings: Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) 2009
Pages: 6 pp.
Location: Gaithersburg, MD
Dates: September 21-23, 2009
Keywords: Map evaluation; RoboCup; Performance Metrics; Performance; Measurement
Research Areas: Manipulation, Robotics, Mobility
PDF version: PDF Document Click here to retrieve PDF version of paper (815KB)