Skip to main content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.


The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Effective and Scalable Uncertainty Evaluation for Large-Scale Complex System Applications



Kevin L. Mills, James J. Filliben, Junfei Xie, Yan Wan, Yi Zhou, Yu Lei


Effective uncertainty evaluation is a critical step toward real-time and robust decision-making for complex systems in uncertain environments. A Multivariate Probabilistic Collocation Method (M-PCM) was developed to effectively evaluate system uncertainty. The method smartly chooses a limited number of simulations to produce a low-order mapping, which precisely predicts the mean output of the original system mapping up to certain degrees. While the M-PCM significantly reduces the number of simulations, it does not scale with the number of uncertain parameters, making it difficult to use for large-scale applications that typically involve a large number of uncertain parameters. In this paper, we develop a method to break the curse of dimensionality. The method integrates M-PCM and Orthogonal Fractional Factorial Design (OFFD) to maximally reduce the number of simulations from 2**2m to 2**⌈log2(m+1)⌉ for a system mapping of m parameters. The integrated M-PCM-OFFD predicts the correct mean of the original system mapping, and is the most robust to numerical errors among all possible designs of the same number of simulations. The analysis also provides new insightful formal interpretations on the optimality of OFFDs.
Proceedings Title
Proceedings of the 2014 Winter Simulation Conference
Conference Dates
December 7-10, 2014
Conference Location
Savannah, GA


complex systems, multivariate probabilistic collocation method, orthogonal fractional factorial design, uncertainty evaluation
Created December 7, 2014, Updated November 10, 2018