NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.

Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.

U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

PUBLICATIONS

Metrics for Evaluation of Software Technology to Support Intelligence Analysis

Published

Author(s)

Jean C. Scholtz

Abstract

For the past two years we have been involved in evaluation of software technologies designed to improve analysis. We have been conducting evaluations both in the laboratory and in operational environments. While usability is an important aspect of software for intelligence analysis, our work has gone beyond usability and focused on utility. We have been using top-down and bottom -up procedures to develop metrics and evaluation methodologies, including literature reviews and expert opinions, laboratory studies, baseline creation, and field observations. Our laboratory work has focused on strategic, open source analysis. Our field work to date has been more in the tactical area all source domain. In this paper, we discuss a number of metrics we have developed and outline some issues involved in evaluation of software to support intelligence analysts.
Proceedings Title
Human Factors and Ergonomics Society
Pub Type
Conferences

Keywords

evaluation, intelligence analysis, metrics, utility
Data and informatics

Citation

Scholtz, J. (2005), Metrics for Evaluation of Software Technology to Support Intelligence Analysis, Human Factors and Ergonomics Society (Accessed October 26, 2025)

Issues

If you have any questions about this publication or are having problems accessing it, please contact [email protected].

Created October 1, 2005, Updated February 19, 2017
Was this page helpful?