Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Efficient Parameter Exploration of Simulation Studies

Published

Author(s)

Megan Olsen, M S Raunak

Abstract

Simulation is a useful and effective way to analyze and study complex, real-world systems. It allows researchers, practitioners, and decision makers to make sense of the inner working of a system that involves many factors often resulting in some sort of emerging behavior. Scenarios such as the spread of a pandemic, the operations of an autonomous vehicle on busy streets, or the flow of patients in an emergency room can be studied with simulation models. Agent based modeling or ABM is a common modeling technique used in simulating and studying such complex systems. In these models, agents are individual autonomous entities that make decisions about their actions and interactions within the environment. The factors that influence the agent's decision making process and thus drive the simulation outcome are commonly known as parameters. A typical agent-based simulation model will include many parameters, each with a potentially large set of values. The number of scenarios with different parameter value combinations grows exponentially and quickly becomes infeasible to test them all or even to explore a suitable subset of them. How does one then efficiently identify the parameter value combinations that matter for a particular simulation study? In addition, is it possible to train a machine learning model to predict the outcome of an agent-based model without running the agent-based model for all parameter value combinations? In this presentation, we discuss the problem of handling large parameter spaces, the use of covering arrays to decrease the space for this type of problem, and the application of machine learning to predict the result of ABMs using the covering array data to choose a representative part of the parameter value space.
Proceedings Title
The proceedings of the IEEE Computer Technology Conference (STC) 2022
Conference Dates
October 3-6, 2022
Conference Location
Gaithersburg, MD, US
Conference Title
The IEEE Computer Technology Conference (STC) 2022

Keywords

simulation, parameter exploration, covering arrays, combinatorial approach

Citation

Olsen, M. and Raunak, M. (2022), Efficient Parameter Exploration of Simulation Studies, The proceedings of the IEEE Computer Technology Conference (STC) 2022, Gaithersburg, MD, US, [online], https://doi.org/10.1109/STC55697.2022.00034, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=935546 (Accessed June 20, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created November 18, 2022, Updated August 10, 2023