Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots
Adam S. Jacoff, Hui-Min Huang, Elena R. Messina, Ann M. Virts, Anthony J. Downs
Robots must possess certain sets of capabilities to suit critical operations such as emergency responses. In the mobility function, ground robots must be able to handle many types of obstacles and terrain complexities, including traversing and negotiating positive and negative obstacles, various types of floor surfaces or terrains, and confined passageways. Additional mobility requirements include the ability to sustain specified speeds and to tow payload with different weights. Standard test methods are required to evaluate how well candidate robots meet these requirements. A set of test methods focused on evaluating the mobility function has been collected into a test suite. Likewise, in other functions such as sensing, communication, manipulation, energy/power, Human-System Interaction (HSI), logistics, and safety, corresponding test suites are required. Also needed are test suites for aerial and aquatic robots. Under the sponsorship of DHS, NIST researchers are collaborating with others to establish such a collection of test suites under the standards development organization ASTM International. Apparatuses must be set up to challenge specific robot capabilities in repeatable ways to facilitate direct comparison of different robot models as well as particular configurations of similar robot models.
Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop
, Huang, H.
, Messina, E.
, Virts, A.
and Downs, A.
Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots, Proceedings of the 2010 Performance Metrics for Intelligent Systems (PerMIS) Workshop, Baltimore, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=906931
(Accessed February 23, 2024)