Morse, E.
, Steves, M.
and Scholtz, J.
(2006),
Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts, 2005 International Conference on Intelligence Analysis, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=150261
(Accessed October 16, 2025)
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts
Published
Author(s)
, ,
Abstract
In this paper we discuss the evaluation methodologies and metrics we have developed for ARDA's Novel Intelligence for Massive Data (NIMD) program. We discuss the challenges of developing methods and metrics in a situation where software components that were to be tested were in very early stages of development and where investigators who might be on the leading edge with respect to their technology were novices with respect to evaluation. Additionally, we discuss how our process of evaluation design is evolving as we gain experience with metrics and measures that are obtainable, yet have some value as indicators of future software performance in the field.Proceedings Title
2005 International Conference on Intelligence Analysis
Pub Type
Conferences
Download Paper
Keywords
analytic process, metrics, observational studies, qualitative data, quantitative data
Citation
Issues
If you have any questions about this publication or are having problems accessing it, please contact [email protected].
Created August 21, 2006, Updated February 19, 2017