Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

2007 Performance Metrics for Intelligent Systems (PerMIS'07) Workshop

PerMIS'07 will be the seventh in the series that started in 2000, targeted at defining measures and methodologies of evaluating performance of intelligent systems. The workshop has proved to be an excellent forum for discussions and partnerships, dissemination of ideas, and future collaborations in an informal setting. Attendees usually include researchers, graduate students, practitioners from industry, academia, and government agencies.

The cardinal theme of this year's workshop will be the interplay between autonomy and intelligence, i.e. how does autonomy influence intelligence and vice versa. Inaddition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. Topic areas include, but are not limited to:

  • Defining and measuring aspects of a system:
    • The level of autonomy
    • Human-robot interaction
    • Collaboration
  • Evaluating components within intelligent systems:
    • Sensing and perception
    • Knowledge representation, world models, ontologies
    • Planning and control
    • Learning and adapting
    • Reasoning
  • Infrastructural support for performance evaluation:
    • Testbedsand competitions for intercomparisons
    • Instrumentation and other measurement tools
    • Simulation and modeling support
  • Technology readiness measures for intelligent systems
  • Applied performance measures in various domains, e.g.,
    • Intelligent transportation systems
    • Emergency response robots (search and rescue, bomb disposal)
    • Homeland security systems
    • De-mining robots
    • Defense robotics
    • Hazardous environments (e.g., nuclear remediation)
    • Industrial and manufacturing systems
    • Space/Aerial robotics
    • Medical Robotics & Assistive devices

Selected papers from the past workshops have been published as special issues with the Journal of Integrated Computer-Aided Engineering(PerMIS'04) and the Journal of Field Robotics(PerMIS'06).

The Proceedings of PerMIS'07 will be indexed by INSPEC (EI Compendexis pending approval) and are released as a NIST Special Publication.

Past Workshops


NIST, IEEE and Association for Computing Machinery Special Interest Group on Artificial Intelligence (ACM-SIGART)

Call for Papers (pdf)

Plenary Addresses

PerMIS Program and Digests (pdf)

Program at a Glance (pdf)

Final Proceedings (pdf)

Created November 15, 2010, Updated September 21, 2016