Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts

Published

Author(s)

Emile L. Morse, Michelle P. Steves, Jean C. Scholtz

Abstract

In this paper we discuss the evaluation methodologies and metrics we have developed for ARDA's Novel Intelligence for Massive Data (NIMD) program. We discuss the challenges of developing methods and metrics in a situation where software components that were to be tested were in very early stages of development and where investigators who might be on the leading edge with respect to their technology were novices with respect to evaluation. Additionally, we discuss how our process of evaluation design is evolving as we gain experience with metrics and measures that are obtainable, yet have some value as indicators of future software performance in the field.
Proceedings Title
2005 International Conference on Intelligence Analysis

Keywords

analytic process, metrics, observational studies, qualitative data, quantitative data

Citation

Morse, E. , Steves, M. and Scholtz, J. (2006), Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts, 2005 International Conference on Intelligence Analysis, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=150261 (Accessed February 24, 2024)
Created August 21, 2006, Updated February 19, 2017