A Standard Test Course for Urban Search and Rescue Robots

Published

August 1, 2000

Author(s)

Adam S. Jacoff, Elena R. Messina, John Evans

Abstract

One approach to measuring the performance of intelligent systems is to develop standardized or reproducible tests. These tests may be in a simulated environment or in a physical test course. The National Institute of Standards and Technology is developing a test course for evaluating the performance of mobile autonomous robots operating in an urban search and rescue mission. The test course is designed to simulate a collapsed building structure at various levels of fidelity. The course will be used in robotic competitions, such as the AAAI Mobile Robot Competition and the RoboCup Rescue. Designed to be highly reconfigurable and to accommodate a variety of sensing and navigation capabilities, this course may serve as a prototype for further development of performance testing environments. The design of the test course brings to light several challenges in evaluating performance of intelligent systems, such as the distinction between mind and body and the accommodation of high-level interactions between the robot and humans. We discuss the design criteria for the test course and the evaluation methods that are being planned.

Proceedings Title

Performance Metrics for Intelligent Systems, Workshop | | | NIST

Conference Dates

August 14-16, 2000

Conference Title

Performance Metrics for Intelligent Systems

Pub Type

Conferences

Download Paper

Local Download

Keywords

autonomous robots, intelligent systems, mobile robots, performance metrics, urban search and rescue

Citation

Jacoff, A. , Messina, E. and Evans, J. (2000), A Standard Test Course for Urban Search and Rescue Robots, Performance Metrics for Intelligent Systems, Workshop | | | NIST, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=823372 (Accessed April 18, 2024)