Take a sneak peek at the new NIST.gov and let us know what you think!
(Please note: some content may not be complete on the beta site.).

View the beta site
NIST logo
Bookmark and Share

2007 Performance Metrics for Intelligent Systems (PerMIS'07) Workshop


PerMIS'07 will be the seventh in the series that started in 2000, targeted at defining measures and methodologies of evaluating performance of intelligent systems. The workshop has proved to be an excellent forum for discussions and partnerships, dissemination of ideas, and future collaborations in an informal setting. Attendees usually include researchers, graduate students, practitioners from industry, academia, and government agencies.

The cardinal theme of this year’s workshop will be the interplay between autonomy and intelligence, i.e. how does autonomy influence intelligence and vice versa. Inaddition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. Topic areas include, but are not limited to:

  • Defining and measuring aspects of a system:
    • The level of autonomy
    • Human-robot interaction
    • Collaboration
  • Evaluating components within intelligent systems:
    • Sensing and perception
    • Knowledge representation, world models, ontologies
    • Planning and control
    • Learning and adapting
    • Reasoning
  • Infrastructural support for performance evaluation:
    • Testbedsand competitions for intercomparisons
    • Instrumentation and other measurement tools
    • Simulation and modeling support
  • Technology readiness measures for intelligent systems
  • Applied performance measures in various domains, e.g.,
    • Intelligent transportation systems
    • Emergency response robots (search and rescue, bomb disposal)
    • Homeland security systems
    • De-mining robots
    • Defense robotics
    • Hazardous environments (e.g., nuclear remediation)
    • Industrial and manufacturing systems
    • Space/Aerial robotics
    • Medical Robotics & Assistive devices

Selected papers from the past workshops have been published as special issues with the Journal of Integrated Computer-Aided Engineering(PerMIS’04) and the Journal of Field Robotics(PerMIS’06).

The Proceedings of PerMIS’07 will be indexed by INSPEC (EI Compendexis pending approval) and are released as a NIST Special Publication.

Past Workshops


Start Date: Tuesday, August 28, 2007
End Date: Thursday, August 30, 2007
Location: Courtyard Gaithersburg Washingtonian Center
Format: Workshop


NIST, IEEE and Association for Computing Machinery Special Interest Group on Artificial Intelligence (ACM-SIGART)

Call for Papers (pdf)

Plenary Addresses

PerMIS Program and Digests (pdf)

Program at a Glance (pdf)

Final Proceedings (pdf)

Technical Contact:

General Chair
Elena Messina, NIST

Program Chair
Raj Madhavan, ORNL/NIST

Program Committee
R. Bonneau AFRL USA
S. Balakirsky NIST USA
G. Berg-Cross EM&I USA
J. Bornstein Army Res. Lab. USA
S. Carpin UC Merced USA
J. Evans USA
D. Gage XPM Tech. USA
J. Gunderson Gamma Two, Inc. USA
L. Gunderson Gamma Two, Inc. USA
A. Jacoff NIST USA
S. Julier Univ. College London UK
T. Kalmar-Nagy Texas A&M USA
R. Lakaemper Temple Univ. USA
L. Latecki Temple Univ. USA
M. Lewis Univ. of Pittsburgh USA
A. del Pobil Univ. Jaume-I, Spain
L. Reeker NIST USA
C. Schlenoff NIST USA
A. Schultz Navy Res. Lab. USA
M. Shneier NIST USA
R. Smith OSD USA
R. Tilove General Motors USA
E. Tunstel Jet Propulsion Lab. USA

Plenary Addresses
Prof. Maria Gini
University of Minnesota USA

Dr. Eric Krotkov
Griffin Technologies USA

Prof. IllahNourbakhsh
Robotics Institute CMU USA

Dr. Alex Zelinsky
CSIRO ICT Centre Australia