Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

A Standard Test Course for Urban Search and Rescue Robots



Adam S. Jacoff, Elena R. Messina, John Evans


One approach to measuring the performance of intelligent systems is to develop standardized or reproducible tests. These tests may be in a simulated environment or in a physical test course. The National Institute of Standards and Technology is developing a test course for evaluating the performance of mobile autonomous robots operating in an urban search and rescue mission. The test course is designed to simulate a collapsed building structure at various levels of fidelity. The course will be used in robotic competitions, such as the AAAI Mobile Robot Competition and the RoboCup Rescue. Designed to be highly reconfigurable and to accommodate a variety of sensing and navigation capabilities, this course may serve as a prototype for further development of performance testing environments. The design of the test course brings to light several challenges in evaluating performance of intelligent systems, such as the distinction between mind and body and the accommodation of high-level interactions between the robot and humans. We discuss the design criteria for the test course and the evaluation methods that are being planned.
Proceedings Title
Performance Metrics for Intelligent Systems, Workshop | | | NIST
Conference Dates
August 14-16, 2000
Conference Title
Performance Metrics for Intelligent Systems


autonomous robots, intelligent systems, mobile robots, performance metrics, urban search and rescue


Jacoff, A. , Messina, E. and Evans, J. (2000), A Standard Test Course for Urban Search and Rescue Robots, Performance Metrics for Intelligent Systems, Workshop | | | NIST, [online], (Accessed June 24, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created August 1, 2000, Updated February 17, 2017