Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Performance Assessments of Android-powered Military Applications Operating on Tactical Handheld Devices

Published

Author(s)

Brian A. Weiss, Lisa J. Fronczek, Emile L. Morse, Zeid Kootbally, Craig I. Schlenoff

Abstract

Transformative Apps (TransApps) is a DARPA-funded program whose goal is to develop a range of militarily-relevant software applications ("apps") to enhance the operational-effectiveness of military personnel on (and off) the battlefield. TransApps is also developing a military apps marketplace to facilitate rapid development and dissemination of applications to address user needs by connecting engaged communities of end-users with development groups. The National Institute of Standards and Technology's (NIST) role in the TransApps program is to design and implement evaluation procedures to assess the performance of: 1) the various software applications, 2) software-hardware interactions, and 3) the supporting online application marketplace. Specifically, NIST is responsible for evaluating 50+ tactically-relevant applications operating on numerous Android-powered platforms. NIST efforts include functional regression testing and quantitative performance testing. This paper discusses the evaluation methodologies employed to assess the performance of three key program elements: 1) handheld-based applications and their integration with various hardware platforms, 2) client-based applications and 3) network technologies operating on both the handheld and client systems along with their integration into the application marketplace. Handheld-based applications are assessed using a combination of utility and usability-based checklists and quantitative performance tests. Client-based applications are assessed to replicate current overseas disconnected (i.e. no network connectivity between handhelds) operations and to assess connected operations envisioned for later use. Finally, networked applications are assessed on handhelds to establish baselines of performance for when connectivity will be common usage.
Proceedings Title
SPIE Defense, Security, and Sensing: Mobile Multimedia/Image Processing Security, and Applications 2013 Conference
Conference Dates
April 29-May 3, 2013
Conference Location
Baltimore, MD

Keywords

Performance Evaluation, Metrics, Android, Military, Functional Testing, Regression Testing, Usability

Citation

Weiss, B. , Fronczek, L. , Morse, E. , Kootbally, Z. and Schlenoff, C. (2013), Performance Assessments of Android-powered Military Applications Operating on Tactical Handheld Devices, SPIE Defense, Security, and Sensing: Mobile Multimedia/Image Processing Security, and Applications 2013 Conference, Baltimore, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=913756 (Accessed June 17, 2021)
Created August 1, 2013, Updated February 19, 2017