A Standard Test Course for Urban Search and Rescue Robots
Adam S. Jacoff, Elena R. Messina, John Evans
One approach to measuring the performance of intelligent systems is to develop standardized or reproducible tests. These tests may be in a simulated environment or in a physical test course. The National Institute of Standards and Technology is developing a test course for evaluating the performance of mobile autonomous robots operating in an urban search and rescue mission. The test course is designed to simulate a collapsed building structure at various levels of fidelity. The course will be used in robotic competitions, such as the AAAI Mobile Robot Competition and the RoboCup Rescue. Designed to be highly reconfigurable and to accommodate a variety of sensing and navigation capabilities, this course may serve as a prototype for further development of performance testing environments. The design of the test course brings to light several challenges in evaluating performance of intelligent systems, such as the distinction between mind and body and the accommodation of high-level interactions between the robot and humans. We discuss the design criteria for the test course and the evaluation methods that are being planned.
Performance Metrics for Intelligent Systems, Workshop | | | NIST
autonomous robots, intelligent systems, mobile robots, performance metrics, urban search and rescue
, Messina, E.
and Evans, J.
A Standard Test Course for Urban Search and Rescue Robots, Performance Metrics for Intelligent Systems, Workshop | | | NIST, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=823372
(Accessed February 21, 2024)