Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Search Publications by:

Search Title, Abstract, Conference, Citation, Keyword or Author
Displaying 26 - 50 of 150

Technology Readiness Levels for Randomized Bin Picking

June 13, 2012
Author(s)
Jeremy A. Marvel, Roger D. Eastman, Geraldine S. Cheok, Kamel S. Saidi, Tsai Hong Hong, Elena R. Messina
A proposal for the utilization of Technology Readiness Levels to the application of unstructured bin picking is discussed. A special session was held during the 2012 Performance Metrics for Intelligent Systems workshop to discuss the challenges and

2011 Solutions in Perception Challenge Performance Metrics and Results

March 22, 2012
Author(s)
Jeremy Marvel, Tsai H. Hong, Elena R. Messina
The 2011 Solutions in Perception Challenge (SPC) presented an international collection of teams with the opportunity to develop algorithms that could positively identify and accurately locate in space an arbitrary collection of artifacts. Researchers at

Co-X Panel Discussion

February 4, 2011
Author(s)
Elena R. Messina, Brian A. Weiss, Rajmohan Madhavan
Robots as co-protectors, co-inhabitants, co-workers, co-integrants, or more generically, "Co-X" will improve effectiveness, efficiency, safety, security, and improve quality of life in the coming years. In-keeping with the theme of PerMIS'10, which

Comprehensive Standard Test Suites for the Performance Evaluation of Mobile Robots

January 31, 2011
Author(s)
Adam S. Jacoff, Hui-Min Huang, Elena R. Messina, Ann M. Virts, Anthony J. Downs
Robots must possess certain sets of capabilities to suit critical operations such as emergency responses. In the mobility function, ground robots must be able to handle many types of obstacles and terrain complexities, including traversing and negotiating

2009 Performance Metrics for Intelligent Systems (PerMIS'09) Workshop

July 9, 2010
Author(s)
Rajmohan Madhavan, Elena R. Messina
The Performance Metrics for Intelligent Systems (PerMIS) workshop is dedicated to defining measures and methodologies of evaluating performance of intelligent systems. The main theme of the ninth iteration of the workshop, PerMIS'09, addressed the question

Performance Evaluation and Benchmarking of Robotic and Automation Systems

March 31, 2010
Author(s)
Rajmohan Madhavan, Elena R. Messina, Angel P. Del Pobil
The Technical Committee on Performance Evaluation and Benchmarking for Robotic and Automation Systems (TC-PEBRAS) was approved at the Technical Activities Board (TAB) meeting held at the 2009 International Conference on Robotics and Automation (ICRA) in

Performance Measures Framework for Unmanned Systems (PerMFUS): Initial Perspective

February 18, 2010
Author(s)
Hui-Min Huang, Elena R. Messina, Adam S. Jacoff
The performance of intelligent unmanned systems (UMS) must be able to be measured to ensure that they can meet the operational requirements. A generic framework to enable capturing and organizing the performance metrics are highly desirable. In this

DYNAMIC PERCEPTION WORKSHOP REPORT: Requirements and Standards for Advanced Manufacturing

January 14, 2010
Author(s)
Tsai Hong Hong, Elena R. Messina, Hui-Min Huang, Michael O. Shneier, Roger D. Eastman, Jane Shi, James Wells
The Dynamic Perception workshop was intended to further the development of standardized, reproducible, and portable test methods that can advance the technology of sensors and perception systems for new, flexible robotic and automation applications in

Robots to the Rescue

June 30, 2009
Author(s)
Elena R. Messina
Despite current limitations, robots can still play a significant role in helping the response community by being their eyes and ears in dangerous, unknown, or difficult-to-access locations. This article describes how the National Institute of Standards and

Stepfield Pallets: Repeatable Terrain for Evaluating Robot Mobility

December 31, 2008
Author(s)
Adam S. Jacoff, Anthony J. Downs, Ann M. Virts, Elena R. Messina
Stepfield pallets are a fabricated and repeatable terrain for evaluating robot mobility. They were developed to provide emergency responders and robot developers a common mobility challenge that could be easily replicated to capture statistically

Ontological Perspectives for Autonomy Performance

August 21, 2008
Author(s)
Hui-Min Huang, Elena R. Messina, Tsai Hong Hong, Craig I. Schlenoff
Goals must be assigned for any unmanned system’s (UMS) operation before the system’s autonomous performance can be measured. In this paper, we began to construct an ontology for mission goals that could serve as a template for stating the goal. We apply

Design and Validation of a Whegs Robot in USARSim

January 31, 2008
Author(s)
B K. Taylor, Stephen B. Balakirsky, Elena R. Messina, R D. Quinn
Simulation of robots and other vehicles in a virtual domain has multiple benefits. End users can use the simulation as a training tool to increase their familiarity and skill with the vehicle without risking damage to the robot, potential bystanders, or

Maze Hypothesis Development in Assessing Robot Performance During Teleoperation

September 28, 2007
Author(s)
Salvatore P. Schipani, Elena R. Messina
National Institute of Standards and Technology (NIST) personnel had the opportunity to assess 14 prospective Urban Search and Rescue (USAR) robots, for the purposes of developing performance standards which currently do not exist. During this exercise, a

Test Methods and Knowledge Representation for Urban Search and Rescue Robots

August 17, 2007
Author(s)
Craig I. Schlenoff, Elena R. Messina, Alan M. Lytle, Brian A. Weiss, Ann M. Virts
In this paper, we described an effort in which NIST is working with FEMA Task Force members to define performance requirements and standard test methods as well as to assess the deployment potential of robots applied to the USAR domain. This process has

Urban Search and Rescue Robot Performance Standards: Progress Update

June 15, 2007
Author(s)
Adam S. Jacoff, Elena R. Messina
In this paper, we describe work in performance standards for urban search and rescue (US&R) robots, begun in 2004 by the Department of Homeland Security. This program is being coordinated by the National Institute of Standards and Technology and will

Measuring the Performance of Urban Search and Rescue Robots

May 17, 2007
Author(s)
Elena R. Messina, Adam S. Jacoff
The Department of Homeland Security is sponsoring development of standards for urban search and rescue (USAR) robots. This program is being coordinated by the National Institute of Standards and Technology and will result in consensus standards developed

Standards Development for Wireless Communications for Urban Search and Rescue Robots

February 26, 2007
Author(s)
Kate Remley, Galen H. Koepke, Elena R. Messina, Adam S. Jacoff, George Hough
To gather data in support of standards development for urban search and rescue robots, NIST is conducting a series of field tests to quantify the functionality and performance of various candidate robots. During these tests, manufacturers bring robots that