Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.


The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

2003 Performance Metrics for Intelligent Systems (PerMIS'03) Workshop

In the fourth workshop in a series targeted at defining measures and methodologies of evaluating performance of intelligent systems, we will examine more closely applications of performance measures to practical problems in commercial, industrial, and military applications. In the quest for providing researchers, users, and developers of intelligent systems with meaningful and usable measures and methodologies, we will attempt to draw upon measurement technologies and practices from other disciplines.

Papers and invited sessions are being sought. Topic areas include, but are not limited to

Leveraging Measures from other disciplines: 

  • Technology Readiness Levels (TRL)
  • Uncertainty Measures
  • Complexity Measures, such as Kolmogorov
  • Biometric Approaches
  • Linguistic Approaches
  • Levels of Autonomy
  • Cognitive Science Approaches
 Measuring Components of Intelligent Systems
  • Sensing and Perception
  • Modeling and Knowledge Content, Representation
  • Planning and Control
  • Learning and Adapting
  • Communications with Humans (and Other Systems)
  • Collaboration with Other Systems (and Humans)

Code of Best Practice for Experimentation
Testbeds and Competitions for Inter-comparisons
Tools for Facilitating Performance Measures
Evaluating Architectures for Intelligence

Past Workshops


NIST, DARPA, IEEE Control Systems Society, IEEE Systems, Man, and Cybernetics Society in cooperation with IEEE Neural Network Council.

Call for Papers (pdf)

Plenary Addresses

PerMIS 2003 Agenda (pdf)

Created November 17, 2010, Updated September 21, 2016