Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts
Emile L. Morse, Michelle P. Steves, Jean C. Scholtz
In this paper we discuss the evaluation methodologies and metrics we have developed for ARDA's Novel Intelligence for Massive Data (NIMD) program. We discuss the challenges of developing methods and metrics in a situation where software components that were to be tested were in very early stages of development and where investigators who might be on the leading edge with respect to their technology were novices with respect to evaluation. Additionally, we discuss how our process of evaluation design is evolving as we gain experience with metrics and measures that are obtainable, yet have some value as indicators of future software performance in the field.
2005 International Conference on Intelligence Analysis
, Steves, M.
and Scholtz, J.
Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts, 2005 International Conference on Intelligence Analysis, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=150261
(Accessed February 24, 2024)