NIST logo

Publication Citation: Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots

NIST Authors in Bold

Author(s): Adam S. Jacoff; Hui-Min Huang; Elena R. Messina; Ann M. Virts; Anthony J. Downs;
Title: Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots
Published: January 31, 2011
Abstract: Robots must possess certain sets of capabilities to suit critical operations such as emergency responses. In the mobility function, ground robots must be able to handle many types of obstacles and terrain complexities, including traversing and negotiating positive and negative obstacles, various types of floor surfaces or terrains, and confined passageways. Additional mobility requirements include the ability to sustain specified speeds and to tow payload with different weights. Standard test methods are required to evaluate how well candidate robots meet these requirements. A set of test methods focused on evaluating the mobility function has been collected into a test suite. Likewise, in other functions such as sensing, communication, manipulation, energy/power, Human-System Interaction (HSI), logistics, and safety, corresponding test suites are required. Also needed are test suites for aerial and aquatic robots. Under the sponsorship of DHS, NIST researchers are collaborating with others to establish such a collection of test suites under the standards development organization ASTM International. Apparatuses must be set up to challenge specific robot capabilities in repeatable ways to facilitate direct comparison of different robot models as well as particular configurations of similar robot models.
Proceedings: Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop
Pages: pp. 166 - 173
Location: Baltimore, MD
Dates: September 28-29, 2010
Keywords: energy; environment; goal; human-system interaction; HSI; measure; metrics; mobility; power; radio communications; robot; performance; sensor; standard; task; terminology; test; test method; test suite
Research Areas: Robotics, Urban search and rescue robots
PDF version: PDF Document Click here to retrieve PDF version of paper (453KB)