Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Effective and Scalable Uncertainty Evaluation for Large-Scale Complex System Applications



Kevin L. Mills, James J. Filliben, Junfei Xie, Yan Wan, Yi Zhou, Yu Lei


Effective uncertainty evaluation is a critical step toward real-time and robust decision-making for complex systems in uncertain environments. A Multivariate Probabilistic Collocation Method (M-PCM) was developed to effectively evaluate system uncertainty. The method smartly chooses a limited number of simulations to produce a low-order mapping, which precisely predicts the mean output of the original system mapping up to certain degrees. While the M-PCM significantly reduces the number of simulations, it does not scale with the number of uncertain parameters, making it difficult to use for large-scale applications that typically involve a large number of uncertain parameters. In this paper, we develop a method to break the curse of dimensionality. The method integrates M-PCM and Orthogonal Fractional Factorial Design (OFFD) to maximally reduce the number of simulations from 2**2m to 2**⌈log2(m+1)⌉ for a system mapping of m parameters. The integrated M-PCM-OFFD predicts the correct mean of the original system mapping, and is the most robust to numerical errors among all possible designs of the same number of simulations. The analysis also provides new insightful formal interpretations on the optimality of OFFDs.
Proceedings Title
Proceedings of the 2014 Winter Simulation Conference
Conference Dates
December 7-10, 2014
Conference Location
Savannah, GA


complex systems, multivariate probabilistic collocation method, orthogonal fractional factorial design, uncertainty evaluation


Mills, K. , Filliben, J. , Xie, J. , Wan, Y. , Zhou, Y. and Lei, Y. (2014), Effective and Scalable Uncertainty Evaluation for Large-Scale Complex System Applications, Proceedings of the 2014 Winter Simulation Conference, Savannah, GA, [online], (Accessed May 26, 2024)


If you have any questions about this publication or are having problems accessing it, please contact

Created December 7, 2014, Updated November 10, 2018