Take a sneak peek at the new NIST.gov and let us know what you think!
(Please note: some content may not be complete on the beta site.).

View the beta site
NIST logo
Bookmark and Share

2012 Performance Metrics for Intelligent Systems (PerMIS'12) Workshop


The 2012 Performance Metrics for Intelligent Systems (PerMIS’12) Workshop will be the eleventh in a series of workshops dedicated to defining measures and methodologies of evaluating performance of intelligent systems. Started in 2000, the PerMIS series focuses on applications of performance measures to applied problems in commercial, industrial, homeland security, and military applications. 

PerMIS’12 will focus on the methodologies and techniques of performance measurement for developing and engineering the next generation of cyber physical systems that facilitate seamless human-machine collaboration. In the context of the Workshop, Cyber Physical Systems (CPS) are taken to mean the “tight conjoining of and coordination between computational and physical resources” [National Science Foundation CPS Program Definition].  

In relation to the main theme, topic areas include, but are not limited to:

  • Defining, Measuring, and Engineering Capabilities of CPS:
    • Human-System Interaction, Collaboration and Coordination
    • Interoperability, Safety, Security, and Connectivity
    • Responsiveness, Reliability, Trustworthiness, Interchangeability, Durability
    • Portability, Mobility, and Scalability of Autonomous Systems
    • Levels of Autonomy
    • Predictable and cost-effective measurement science frameworks
  • Evaluating Components within Intelligent Systems:
    • Sensing and Perception
    • Knowledge Representation, World Models, Ontologies
    • Planning and Control
    • Learning, Adapting and Reasoning
  • Underlying Infrastructural Support for Performance Assessment:
    • Testing and Evaluation (including testbeds and competitions for inter-comparisons)
    • Instrumentation and Other Measurement Tools
    • Simulation and Modeling
  • Technology Readiness Measures for Intelligent Systems
  • Benchmarks and Applied Performance Measures and Metrics in Various Domains:
    • Manufacturing, Logistics, and Industrial Systems
    • Service: Domestic, Mining, Agriculture, …
    • Intelligent Transportation Systems
    • Defense and Security
    • Emergency Response Robots (e.g. search and rescue, bomb disposal)
    • Intelligent Systems and Robots for Hazardous Environments (e.g. nuclear remediation)
    • Smart Grid
    • Space Robotics
    • Medical & Healthcare Systems and Devices

The Proceedings of PerMIS are indexed by INSPEC, Compendex, ACM Digital Library, and are released as a NIST Special Publication.

We look forward to your participation in PerMIS'12!

Past Workshops


Start Date: Tuesday, March 20, 2012
End Date: Thursday, March 22, 2012
Location: The Marriott Inn & Conference Center, University of Maryland University College
Audience: Industry, Government, Academia
Format: Workshop


NIST, DARPA, UMD Robotics Center, ACM-SIGART, IEEE-RAS TC-PEBRAS, IEEE W/NV Sensors Council Chapter


Call for Participation

Student Poster Sessions

Plenary Addresses

Submission Information

Travel and Accommodations

PerMIS Program

Program at a Glance

Final Proceedings

Technical Contact:

General Chair
Elena Messina NIST USA

Program Chair
Raj Madhavan UMD-CP/NIST USA

Publications Chair
Brian Weiss NIST USA

Poster Session Chair
Ani Hsieh, Drexel U USA

Program Committee
S. Balakirsky NIST USA
G. Berg-Cross EM & I USA
G. Blankenship UMD-CP USA
F. Bonsignorio  UC3M Spain
M. Childers ARL USA
J. Gunderson GammaTwo USA
L. Gunderson GammaTwo USA
M. Lewis UPitt USA
A. Hsieh DrexelU USA
L. Moshkina Georgia Tech USA
D. Prokhorov Toyota USA
C. Schlenoff NIST USA
M. Shneier NIST USA
N. Tomatis Bluebotics Switzerland
E. Tunstel JHU-APL USA