Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Scientific Software Sustainability: The Numerical Reproducibility Challenge

Published

Author(s)

Walid Keyrouz, Michael V. Mascagni

Abstract

Experimental reproducibility is a cornerstone of the scientific method. The ease of achieving its counterpart in computing, numerical reproducibility, was one of the core assumptions underpinning the growth of scientific computing over the past several decades to become a powerful tool for scientific inquiry that is now widely considered as the ``third leg of science''. The other core assumption was the deterministic behavior of computer hardware. Unfortunately, these assumptions are currently being challenged by hardware developments over the past several decades as discussed and documented in recent reports and workshops. In this position paper, we are advocating for the following actions: - Redefine numeric reproducibility by considering numeric results as computational measurements and treat them as the equivalent of physical measurements. - Further develop and disseminate algorithms that sustain the newly redefined reproducibility. - Bring approaches used in stochastic algorithms and Monte Carlo Methods to bear on problems more traditionally associated with deterministic approaches. - Carry out simulations as ensemble runs as is becoming the norm in weather forecasting. In this context, we are organizing a workshop on ``Numerical Reproducibility at Exascale'' at SC'15 in Austin, TX, with the goals of bringing a community together to address the issue of Numerical Reproducibility.
Citation
Computational Science & Engineering Software Sustainability and Productivity Challenges (CSESSP Challenges)

Keywords

Numerical Reproducibility, Software Sustainability, Uncertainty Quantification

Citation

Keyrouz, W. and Mascagni, M. (2015), Scientific Software Sustainability: The Numerical Reproducibility Challenge, Computational Science & Engineering Software Sustainability and Productivity Challenges (CSESSP Challenges), [online], https://www.nitrd.gov/csessp/ (Accessed June 18, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 15, 2015, Updated April 30, 2019