Skip to main content

NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Evaluation of RoboCup Maps

Published

Author(s)

Stephen B. Balakirsky, Benjamin Balaguer, Stefano Carpin, Arnoud Visser

Abstract

This paper describes the steps taken to create the score criteria aimed at measuring the quality of maps produced by teams participating in the RoboCup Rescue Virtual Robots competition. Since metrics have already been developed by a few research groups, we start by highlighting the most popular solutions to this problem, emphasizing their strengths and weaknesses. Having put the difficulty of creating map benchmarks into perspective, we present our map benchmark suite, appropriate for Urban Search and Rescue missions, along with examples taken from former competitions.
Proceedings Title
Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) 2009
Conference Dates
September 21-23, 2009
Conference Location
Gaithersburg, MD

Keywords

Map evaluation, RoboCup, Performance Metrics, Performance, Measurement

Citation

Balakirsky, S. , Balaguer, B. , Carpin, S. and Visser, A. (2009), Evaluation of RoboCup Maps, Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) 2009, Gaithersburg, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=904218 (Accessed October 13, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created December 17, 2009, Updated February 19, 2017
Was this page helpful?