Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Metric Mapping Concepts for TIA



Michelle P. Steves, Jean C. Scholtz


In this paper, we present a metrics framework and the underlying concepts that were used to help structure a series of evaluations of software tools to support intelligence workers with their data filtering and analytic processes. The deployment of the tool suite and subsequent evaluations were part of the Terrorist Information Awareness (TIA) program, a Defense Advanced Research Projects Agency (DARPA) -sponsored effort. First we summarize some of the requirements of the evaluations which drove the development of the framework. We enumerate some of the benefits of a top-down approach, particularly the GQM method from which the metrics framework is adapted. Then, we present the framework and its constituent elements. An excerpt of an instantiation of the metrics framework is shown and discussed for an example evaluation situation. Finally, we describe how the metrics framework can be used in comparative studies.
NIST Interagency/Internal Report (NISTIR) - 7061
Report Number


comparative evaluations, evaluation design, evaluation framework, measurement, software evaluation, software metrics framework


Steves, M. and Scholtz, J. (2004), Metric Mapping Concepts for TIA, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online],, (Accessed July 18, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created July 31, 2004, Updated October 12, 2021