NIST logo

Publication Citation: The ghost in the machine: Don't let it haunt your software performance measurements

NIST Authors in Bold

Author(s): Vreda Pieterse; David W. Flater;
Title: The ghost in the machine: Don't let it haunt your software performance measurements
Published: April 28, 2014
Abstract: This paper describes pitfalls, issues, and methodology for measuring software performance. Ideally, measurement should be performed and reported in such a way that others will be able to reproduce the results in order to confirm their validity. We aim to motivate scientists to apply the necessary rigor to the design and execution of their software performance measurements to achieve reliable results. Repeatability of experiments, comparability of reported results, and verifiability of claims that are based on such results can be achieved only when measurements and reporting procedures can be trusted. In short, this paper urges the reader to measure the right performance and to measure the performance right.
Citation: NIST TN - 1830
Research Areas: Information Technology, Software Testing Metrics, Measurements
DOI: http://dx.doi.org/10.6028/NIST.TN.1830