Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

An Automated Benchmarking Toolset

Published

Author(s)

M M. Courson, G J. Marcais, Alan Mink, B Traverse

Abstract

The performance drive of parallel computing and platform upgrades or replacements are among the reasons frequent running of benchmark codes has become commonplace for application and platform evaluation and tuning. NIST is developing a prototype for an automated benchmarking toolset to reduce the manual effort in running and analyzing the results of such benchmarks. Our toolset consists of 3 main modules. A Data Collection and Storage module handles the collection of performance data and implements a central repository for such data. Another module provides an integrated mechanism to analyze and visualize the data stored in the repository. An Experiment Control Module assists the user in designing and executing experiments. To reduce the development effort this toolset is built around existing tools and is designed to be easily extensible to support other tools.
Citation
Springer Verlag Series Lecture Notes
Volume
1823

Keywords

cluster computing, data collection, database, performance analysis, performance measurement, queuing system, visualization

Citation

Courson, M. , Marcais, G. , Mink, A. and Traverse, B. (2000), An Automated Benchmarking Toolset, Springer Verlag Series Lecture Notes, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=151454 (Accessed April 17, 2024)
Created December 31, 1999, Updated October 12, 2021