Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

2003 Performance Metrics for Intelligent Systems (PerMIS'03) Workshop

In the fourth workshop in a series targeted at defining measures and methodologies of evaluating performance of intelligent systems, we will examine more closely applications of performance measures to practical problems in commercial, industrial, and military applications. In the quest for providing researchers, users, and developers of intelligent systems with meaningful and usable measures and methodologies, we will attempt to draw upon measurement technologies and practices from other disciplines.

Papers and invited sessions are being sought. Topic areas include, but are not limited to

Leveraging Measures from other disciplines: 

  • Technology Readiness Levels (TRL)
  • Uncertainty Measures
  • Complexity Measures, such as Kolmogorov
  • Biometric Approaches
  • Linguistic Approaches
  • Levels of Autonomy
  • Cognitive Science Approaches
 Measuring Components of Intelligent Systems
  • Sensing and Perception
  • Modeling and Knowledge Content, Representation
  • Planning and Control
  • Learning and Adapting
  • Communications with Humans (and Other Systems)
  • Collaboration with Other Systems (and Humans)

Code of Best Practice for Experimentation
Testbeds and Competitions for Inter-comparisons
Tools for Facilitating Performance Measures
Evaluating Architectures for Intelligence

Past Workshops


NIST, DARPA, IEEE Control Systems Society, IEEE Systems, Man, and Cybernetics Society in cooperation with IEEE Neural Network Council.

Call for Papers (pdf)

Plenary Addresses

PerMIS 2003 Agenda (pdf)

Created November 17, 2010, Updated September 21, 2016