Research into intelligent systems and intelligent control is burgeoning. However, there is no consensus on how to define or measure an intelligent system. This lack of rigor hinders the ability to measure progress in the field and to compare different systems' capabilities. We discuss some of the challenges and issues in defining performance metrics for intelligent systems and issue a call to action to Intelligent Systems Workshop to define practical metrics that will advance the state of the art and practice.
Proceedings of a NIST conference on Performance Metrics for Intelligent Systems
and Messina, E.
Performance Metrics for Intelligent Systems, Proceedings of a NIST conference on Performance Metrics for Intelligent Systems, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=823385
(Accessed December 6, 2023)