Metric Mapping Concepts for TIA

Published

August 1, 2004

Author(s)

Michelle P. Steves, Jean C. Scholtz

Abstract

In this paper, we present a metrics framework and the underlying concepts that were used to help structure a series of evaluations of software tools to support intelligence workers with their data filtering and analytic processes. The deployment of the tool suite and subsequent evaluations were part of the Terrorist Information Awareness (TIA) program, a Defense Advanced Research Projects Agency (DARPA) -sponsored effort. First we summarize some of the requirements of the evaluations which drove the development of the framework. We enumerate some of the benefits of a top-down approach, particularly the GQM method from which the metrics framework is adapted. Then, we present the framework and its constituent elements. An excerpt of an instantiation of the metrics framework is shown and discussed for an example evaluation situation. Finally, we describe how the metrics framework can be used in comparative studies.

Citation

NIST Interagency/Internal Report (NISTIR) - 7061

Report Number

7061

NIST Pub Series

NIST Interagency/Internal Report (NISTIR)

Pub Type

NIST Pubs

Download Paper

https://doi.org/10.6028/NIST.IR.7061

Local Download

Keywords

comparative evaluations, evaluation design, evaluation framework, measurement, software evaluation, software metrics framework

Citation

Steves, M. and Scholtz, J. (2004), Metric Mapping Concepts for TIA, NIST Interagency/Internal Report (NISTIR), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://doi.org/10.6028/NIST.IR.7061, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=822188 (Accessed October 14, 2025)