Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Search Publications by:

Displaying 101 - 125 of 171

Evaluation Methodology and Metrics Employed to Assess the TRANSTAC Two-way, Speech-to-Speech Translation Systems

February 1, 2013

Author(s)

Gregory A. Sanders, Brian A. Weiss, Craig I. Schlenoff, Michelle P. Steves, Sherri Condon

One of the most difficult challenges that military personnel face when operating in foreign countries is clear and successful communication with the local population. To address this issue, the Defense Advanced Research Projects Agency (DARPA) is funding

2012 Proceedings of the Performance Metrics for Intelligent Systems (PerMI'12) Workshop

November 21, 2012

Author(s)

Rajmohan (. Madhavan, Elena R. Messina, Brian Weiss

The 2012 Performance Metrics for Intelligent Systems workshop is the eleventh in a series dedicated to defining measures and methodologies of evaluating performance of intelligent systems. Started in 2000, the PerMIS series focuses on applications of

Multi-Relationship Evaluation Design: Modeling an Automatic Test Plan Generator

April 11, 2012

Author(s)

Brian A. Weiss, Linda C. Schmidt

Advanced and intelligent systems within the manufacturing, military, homeland security, and automotive fields are constantly emerging and progressing. Testing these technologies is crucial to (1) inform the technology developers of targeted areas for

Multi-Relationship Evaluation Design: Formalizing Evaluation-Design Input and Output Blueprint Elements for Testing Developing Intelligent Systems

January 20, 2012

Author(s)

Brian A. Weiss, Linda C. Schmidt

Intelligent technologies within the military, law enforcement, and homeland security fields are continuously evolving. Testing these technologies is crucial to (1) inform the technology developers of specific aspects for enhancement, (2) request end-user

A Retrospective Analysis of Lessons Learned in Evaluating Advanced Military Technologies

December 30, 2011

Author(s)

Craig I. Schlenoff, Brian A. Weiss, Michelle P. Steves

For the past six years, personnel from the National Institute of Standards and Technology (NIST) have served as the Independent Evaluation Team (IET) for two major DARPA programs. DARPA ASSIST (Advanced Soldier Sensor Information System and Technology) is

Multi-Relationship Evaluation Design: Formalizing Evaluation Design Input and Output Blueprint Elements for Testing Developing Intelligent Systems

October 5, 2011

Author(s)

Brian A. Weiss, Linda C. Schmidt

Multi-Relationship Evaluation Design: Formalizing Test Plan Input and Output Elements for Evaluating Developing Intelligent Systems

August 31, 2011

Author(s)

Brian A. Weiss, Linda C. Schmidt

Advanced and intelligent systems within the manufacturing, military, homeland security, and automotive fields are constantly under development or improvement. Testing the performance of these technologies is critical to (1) update the system designers of

The Multi-Relationship Evaluation Design Framework: Producing Evaluation Blueprints to Test Emerging, Advanced, and Intelligent Technologies

June 30, 2011

Author(s)

Brian A. Weiss, Linda C. Schmidt

This article introduces the Multi-Relationship Evaluation Design (MRED) framework whose objective is to take uncertain input data and automatically output comprehensive evaluation blueprints complete with targeted evaluation elements. MRED is unique in

A Detailed Discussion of Lessons Learned in Evaluating Emerging and Advanced Military Technologies

June 3, 2011

Author(s)

Craig I. Schlenoff, Brian A. Weiss, Michelle P. Steves

Performance Assessments of Two-Way, Free-Form, Speech-to-Speech Translation Systems for Tactical Use

June 3, 2011

Author(s)

Brian A. Weiss, Craig I. Schlenoff

A critical challenge for military personnel when operating in foreign countries is effective communication with the local population. To address this issue, the Defense Advanced Research Projects Agency (DARPA) created the Spoken Language Communication and

Development of Domain-Specific Scenarios for Training and Evaluation of Two-Way, Free Form, Spoken Language Translation Devices

June 1, 2011

Author(s)

Brian A. Weiss, Marnie Menzel

To create effective and accurate two-way, free form, spoken language translation devices, the technologies must have appropriate training data. The goal of the Defense Advanced Research Projects Agency Spoken Language Communication and Translation System

Providing NIST Supervisors with a Continuous Learning Program

April 14, 2011

Author(s)

David W. Griffith, Susan F. Heller-Zeisler, Joy A. Herman, Andrew Jackson, Janine Kerns, Donna J. Sirk, William E. Wallace, Brian Weiss

2010 Proceedings of the Performance Metrics for Intelligent Systems (PerMIS'10) Workshop

February 8, 2011

Author(s)

Rajmohan (. Madhavan, Elena R. Messina, Brian A. Weiss

The 2010 Performance Metrics for Intelligent Systems workshop is the tenth in a series dedicated to defining measures and methodologies of evaluating performance of intelligent systems. Started in 2000, the PerMIS series focuses on applications of