Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Search Publications by:

Search Title, Abstract, Conference, Citation, Keyword or Author
Displaying 26 - 50 of 51

Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts

August 21, 2006
Author(s)
Emile L. Morse, Michelle P. Steves, Jean C. Scholtz
In this paper we discuss the evaluation methodologies and metrics we have developed for ARDA's Novel Intelligence for Massive Data (NIMD) program. We discuss the challenges of developing methods and metrics in a situation where software components that

Overview of the First Advanced Technology Evaluations for ASSIST

January 31, 2006
Author(s)
Craig I. Schlenoff, Brian A. Weiss, Michelle P. Steves, Ann M. Virts, Michael O. Shneier, Michael Linegang
ASSIST (Advanced Soldier Sensor Information Systems Technology) is a DARPA-funded effort whose goal is to exploit soldier-worn sensors to augment the soldier s recall and reporting capability to enhance situation understanding. ASSIST is separated into two

Metric Mapping Concepts for TIA

August 1, 2004
Author(s)
Michelle P. Steves, Jean C. Scholtz
In this paper, we present a metrics framework and the underlying concepts that were used to help structure a series of evaluations of software tools to support intelligence workers with their data filtering and analytic processes. The deployment of the

The AMIS Approach to Systems Integration: An Overview

May 1, 2004
Author(s)
Donald E. Libes, Edward J. Barkmeyer Jr., Peter O. Denno, David Flater, Michelle P. Steves, Evan K. Wallace, Allison Barnard Feeney
This paper is an overview of the AMIS (Automated Methods for Integrating Systems) project approach to systems integration. The objective of the AMIS project is to reduce the cost and time for software integration by devising methods, algorithms, and tools

A Framework for Metrics in Large Complex Systems

March 1, 2004
Author(s)
G A. Mack, K Lonergan, Jean C. Scholtz, Michelle P. Steves, C R. Hale
The Terrorism Information Awareness (TIA) was initiated by the Information Awareness Office (IAO) of the Defense Advanced Research Projects Agency (DARPA). TIA capabilities enable the detection, classification, identification, and tracking of terrorist

The Challenges of Automated Methods for Integrating Systems

January 1, 2004
Author(s)
Donald E. Libes, David Flater, Evan K. Wallace, Michelle P. Steves, Allison Barnard Feeney, Edward J. Barkmeyer Jr.
Automated methods for integrating systems (AMIS) have been presented as a new approach to solving the dilemmas of multiple and uncoordinated standards, ontologies, legacy systems and the ever-growing cost of traditional integration. This paper explores the

Model-Driven Integration Using Legacy Models

August 1, 2003
Author(s)
Peter O. Denno, Michelle P. Steves, Donald E. Libes, Edward J. Barkmeyer Jr.
The paper describes a model-driven method of systems integration using legacy models. The method defines relationships between elements of legacy models to produce an implicit ontology of a subsystem. The implicit ontologies of subsystems to be integrated

Viewing Technologies for CAD Models

August 1, 2003
Author(s)
Michelle P. Steves, Simon P. Frechette
This report describes Computer-Aided Design (CAD) model-viewing technologies1 used to support CAD-model review and analysis. CAD model viewers are tools that allow engineers and other users to view CAD models from distributed locations, often using

Concepts for Automating Systems Integration

February 1, 2003
Author(s)
Edward J. Barkmeyer Jr., Allison Barnard Feeney, Peter O. Denno, David W. Flater, Donald E. Libes, Michelle P. Steves, Evan K. Wallace
The problem of software systems integration getting independently developed software components to communicate in order to support a business application has been altered by the introduction of new software technologies, but by no means eliminated. NIST

Looking at the Whole Picture: A Case Study of Analyzing a Virtual Workplace

May 1, 2001
Author(s)
Michelle P. Steves, Emile L. Morse
Evaluating collaborative systems is much more difficult than evaluating single-user systems due to the number of simultaneous (synchronous) or intertwined (both asynchronous and synchronous) interactions. The types of data that can be gathered are diverse

A Manufacturing Collaboratory Case Study - Companion Document

April 1, 2001
Author(s)
E E. Wierba, Amy Knutilla, Michelle P. Steves
This report summarizes a case study of a collaborative tool intervention within a geographically-distributed, product-development team of an automotive parts supplier. This report serves as a companion document to a larger, more detailed volume, prepared

Evaluating Collaborative Enterprises - A Workshop Report

March 1, 2001
Author(s)
Robert Allen, Michelle P. Steves
As part of the WETICE 2001 conference, the workshop on Evaluating Collaborative Enterprises continued from its debut last year exploring the issues surrounding the evaluation of collaborative enterprises. This exploration included methods and tools for

A Visualization Approach to Dealing with Log Data

January 29, 2001
Author(s)
Emile L. Morse, Michelle P. Steves
The CollabLogger is a visual tool that supports usability analyses of human-computer interaction in a team environment. Participants in our computer-mediated activity were engaged in a small-scale manufacturing testbed project. Interactions of the group

CollabLogger: A Tool for Visualizing Groups at Work

December 28, 2000
Author(s)
Emile L. Morse, Michelle P. Steves
The CollabLogger is a visual tool that has been developed to support usability analyses of human-computer interaction in a team environment. The participants in the computer-mediated activity were engaged in a small-scale manufacturing testbed project

SMAT: Synchronous Multimedia and Annotation Tool

September 1, 2000
Author(s)
Michelle P. Steves, Mudumbai Ranganathan, Emile L. Morse
We describe the design and use of SMAT (Synchronous Multimedia and Annotation Tool), a tool designed to be part of a scientific collaboratory for use in a robotic-arc-welding research project at the National Institute of Standards and Technology (NIST)

A Visualization Approach to Dealing with Log Data

July 1, 2000
Author(s)
Michelle P. Steves, Emile L. Morse
The CollabLogger is a visual tool that supports usability analyses of human-computer interaction in a team environment. Participants in our computer-mediated activity were engaged in a small-scale manufacturing testbed project. Interactions of the group

CollabLogger: A Tool for Visualizing Groups at Work

July 1, 2000
Author(s)
Michelle P. Steves, Emile L. Morse
The CollabLogger is a visual tool that has been developed to support usability analyses of human-computer interaction in a team environment. The participants in the computer-mediated activity were engaged in a small-scale manufacturing testbed project

Mining Usability Information from Log Files: A Multi-Pronged Approach

July 1, 2000
Author(s)
Michelle P. Steves, Emile L. Morse
This is a position paper for a workshop concerned with issues and experiences surrounding logged data for on-line communities. We briefly describe relevant elements of a field study of a group of welding engineers using a collaborative system conducted at

Workshop on Evaluating Collaborative Enterprises - Workshop Report

June 1, 2000
Author(s)
Robert Allen, Amy Knutilla, Michelle P. Steves
The workshop, Evaluating Collaborative Engerprises, explored the issues surrounding the evaluation of collaborative systems including methods and tools for evaluating collaborative software as well as application-specific evaluation experiences. This paper

Collaboration Technologies for Global Manufacturing

October 1, 1999
Author(s)
Michelle P. Steves, Amy Knutilla
One impact of the globalization of manufacturing is the growing requirement for teams that are not co-located to collaborate using shared information. In this paper, we present our approach to instituting and assessing collaboration technologies for

Supporting Manufacturing Process Analysis and Trouble Shooting with ACTS

June 1, 1999
Author(s)
Michelle P. Steves, Wo L. Chang, Amy Knutilla
This paper presents a prototype tool called ACTS (Annotation Collaboration Tool via SMIL), which was designed to meet the user requirements of a distributed, collaborative team performing remote analysis of robotic welds. ACTS is a web-based collaboration

Modified Field Studies for CSCW Systems

January 1, 1999
Author(s)
Michelle P. Steves, Jean C. Scholtz
We, at the National Institute of Standards and Technology (NIST), are in the process of instituting and assessing collaboration technologies for manufacturing applications. This position paper for the Computer Supported Cooperative Work (CSCW) Evaluation

Organization of MSID

January 1, 1996
Author(s)
Michelle P. Steves, Donald E. Libes
This paper presents observations and recommendations regarding the organization of MSID''s (Manufacturing systems Integration Division) publicly accessible information. The paper documents the current structure an) its formative rationales, and lays out a