Take a sneak peek at the new NIST.gov and let us know what you think!
(Please note: some content may not be complete on the beta site.).

View the beta site
NIST logo
Bookmark and Share

2008 Performance Metrics for Intelligent Systems (PerMIS'08) Workshop


PerMIS'08 will be the eighth in the series that started in 2000, targeted at defining measures and methodologies of evaluating performance of intelligent systems. The workshop has proved to be an excellent forum for discussions and partnerships, dissemination of ideas, and future collaborations in an informal setting. Attendees usually include researchers, graduate students, practitioners from industry, academia, and government agencies.

PerMIS’08 aims at identifying and quantifying contributions of functional intelligence towards achieving success. Our working definition of functional intelligence is “the ability to act appropriately in an uncertain environment, where appropriate action is that which increases the probability of success”, and success is “the achievement of behavioral goals” (J. Albus, 1991). In addition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. Topic areas include, but are not limited to: 

  • Defining and measuring aspects of a system:
    • The level of autonomy
    • Human-robot interaction
    • Collaboration & Coordination
    • Taxonomies
  • Evaluating components within intelligent systems:
    • Sensing and perception
    • Knowledge representation, world models, ontologies
    • Planning and control
    • Learning and adapting
    • Reasoning
  • Infrastructural support for performance evaluation:
    • Testbeds and competitions for intercomparisons
    • Instrumentation and other measurement tools
    • Simulation and modeling support
  • Technology readiness measures for intelligent systems
  • Applied performance measures in various domains, e.g.,
    • Intelligent transportation systems
    • Emergency response robots (search and rescue, bomb disposal)
    • Homeland security systems
    • De-mining robots
    • Defense robotics
    • Hazardous environments (e.g., nuclear remediation)
    • Industrial and manufacturing systems
    • Space/Aerial robotics
    • Medical Robotics & assistive devices 

The Proceedings of PerMIS are indexed by INSPEC, Compendex, ACM Digital Library, and are released as a NIST Special Publication. Selected papers from past workshops have been published as special issues with the Journal of Integrated Computer-Aided Engineering (PerMIS’04) and the Journal of Field Robotics (PerMIS’06).


Past Workshops


Start Date: Tuesday, August 19, 2008
End Date: Thursday, August 21, 2008
Format: Workshop


NIST, IEEE and Association for Computing Machinery Special Interest Group on Artificial Intelligence (ACM-SIGART)

CALL for Papers (pdf)

Plenary Addresses

PerMIS Program (pdf)

Program at a Glance (pdf)

Digests (pdf)

Final Proceedings (pdf)

Technical Contact:

General Chair
Elena Messina, NIST

Program Chair
Raj Madhavan, ORNL/NIST  

Program Committee
S. Balakirsky NIST USA
R. Bostelman NIST USA
F. Bonsignorio Heron Robots Italy
G. Berg-Cross EM & I USA
J. Bornstein ARL USA
P. Courtney PerkinElmer UK
J. Evans USA
D. Gage XPM Tech. USA
J. Gunderson GammaTwo USA
L. Gunderson GammaTwo USA
S.K. Gupta UMD USA
A. Jacoff NIST USA
S. Julier Univ. College London UK
M. Lewis UPitt USA
T. Kalmar-Nagy Texas A& M USA
A. del Pobil Univ. Jaume-I Spain
S. Ramasamy UALR USA
L. Reeker NIST USA
C. Schlenoff NIST USA
M. Shneier NIST USA
E. Tunstel JHU-APL USA