Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots

Published

Author(s)

Adam S. Jacoff, Hui-Min Huang, Elena R. Messina, Ann M. Virts, Anthony J. Downs

Abstract

Robots must possess certain sets of capabilities to suit critical operations such as emergency responses. In the mobility function, ground robots must be able to handle many types of obstacles and terrain complexities, including traversing and negotiating positive and negative obstacles, various types of floor surfaces or terrains, and confined passageways. Additional mobility requirements include the ability to sustain specified speeds and to tow payload with different weights. Standard test methods are required to evaluate how well candidate robots meet these requirements. A set of test methods focused on evaluating the mobility function has been collected into a test suite. Likewise, in other functions such as sensing, communication, manipulation, energy/power, Human-System Interaction (HSI), logistics, and safety, corresponding test suites are required. Also needed are test suites for aerial and aquatic robots. Under the sponsorship of DHS, NIST researchers are collaborating with others to establish such a collection of test suites under the standards development organization ASTM International. Apparatuses must be set up to challenge specific robot capabilities in repeatable ways to facilitate direct comparison of different robot models as well as particular configurations of similar robot models.
Proceedings Title
Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop
Conference Dates
September 28-29, 2010
Conference Location
Baltimore, MD

Keywords

energy, environment, goal, human-system interaction, HSI, measure, metrics, mobility, power, radio communications, robot, performance, sensor, standard, task, terminology, test, test method, test suite

Citation

Jacoff, A. , Huang, H. , Messina, E. , Virts, A. and Downs, A. (2011), Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots, Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop, Baltimore, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=906931 (Accessed March 28, 2024)
Created January 31, 2011, Updated February 19, 2017