Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Letter in response to V. Stodden et al., Science 354, 1240 (2016).



Mark W. Maciejewski, Adam D. Schuyler, Michael R. Gryk, Ion I. Moraru, Pedro R. Romero, Eldon L. Ulrich, Hamid R. Eghbalnia, Miron Livny, Frank Delaglio, Jeffrey C. Hoch


Stodden et al. (1) bring welcome attention to the problem of reproducibility of computational analyses, and recommend guidelines for addressing the barriers to reproducibility. However, one important barrier to long-term reproducibility of computational methods was not addressed. This is the problem of software persistence, in the face of rapid obsolescence of operating systems, compilers, interpreters, run-time libraries, or other software components required to execute published code.


Research Reproducibility, Scientific Computing


Maciejewski, M. , Schuyler, A. , Gryk, M. , Moraru, I. , Romero, P. , Ulrich, E. , Eghbalnia, H. , Livny, M. , Delaglio, F. and Hoch, J. (2018), Letter in response to V. Stodden et al., Science 354, 1240 (2016)., Science (Accessed May 25, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created January 1, 2018, Updated October 12, 2021