Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Summary
This project involves determining what attributes of a computer system can cause numerical reproducibility to fail and how the uncertainty resulting from this can be quantified.
Description
The Information Systems group in ITL is developing a program in numerical reproducibility, which has been funded through several projects. Issues with numerical reproducibility are becoming increasingly significant, for several reasons
- Increased use of parallel computing has caused order of operations to become increasingly non-deterministic
- Low-precision data types, such as FP16, are now being used for increased performance
- Longer-running, larger-scale computations provide increased opportunity for numerical errors to accumulate and cause instabilities
Initial work was done through a project on Terascale Imaging. This work examined the numerical reproducibility of several primitive image-processing algorithms such as Fourier Transforms and linear algebra operations. These algorithms were executed on images using a variety of library versions, floating-point precisions, compiler options, CPU and GPU architectures, etc. The project cataloged which combinations of attributes caused breaks in bit-wise numerical reproducibility of the results.
Recent projects have been funded through internal ITL Building the Future grants. These projects have focused on developing practical methods to quantify the uncertainty associated with floating-point operations in scientific computations. Several methods currently exist for quantifying this uncertainty, but they are not generally used in practice, mostly due to performance penalties associated with their use. These projects are attempting to lay the groundwork for accelerated methods, such as through hardware acceleration, by demonstrating the benefits of this uncertainty quantification for reproducibility and providing examples of how it could be used in practice.
Major Accomplishments
- Surveyed attributes of computer systems that can cause breaks in numerical reproducibility for primitive image processing algorithms
- Evaluated the performance of the floating-point uncertainty-quantification tools CADNA [1], Verrou [2], and Verificarlo [3]
[1] http://cadna.lip6.fr/index.php
[2] https://edf-hpc.github.io/verrou/index.html
[3] https://github.com/verificarlo/verificarlo