Predicting ABM Results with Covering Arrays and Random Forests

Published

June 26, 2023

Author(s)

Megan Olsen, M S Raunak, D. Richard Kuhn

Abstract

Simulation is a useful and effective way to analyze and study complex, real-world systems. It allows researchers, practitioners, and de- cision makers to make sense of the inner working of a system that involves many factors often resulting in some sort of emergent behavior. The number parameter value combinations grows exponentially and quickly becomes infeasible to test them all or even to explore a suitable subset of them. How does one then efficiently identify the parameter value combi- nations that matter for a particular simulation study? In addition, is it possible to train a machine learning model to predict the outcome of an agent-based model without running the agent-based model for all param- eter value combinations? We propose utilizing covering arrays to create t-way (t = 2, 3, 4, etc.) combinations of parameter values to significantly reduce the parameter value exploration space for agent-based models. In our prior work we showed that covering arrays were useful for systemat- ically decreasing the parameter space in an agent-based model. We now build on that work by applying it to Wilensky's HeatBugs model and training a random forest machine learning model to predict simulation results by using the covering arrays to select our training and test data. Our results show that a 2-way covering array provides sufficient training data to train our random forest to predict three different simulation out- comes. Our process of using covering arrays to decrease parameter space to then predict ABM results using machine learning is successful.

Proceedings Title

Computational Science – ICCS 2023. Lecture Notes in Computer Science

Volume

14073

Conference Dates

July 3-5, 2023

Conference Location

Prague, CZ

Conference Title

International Conference on Computational Science 2023

Pub Type

Conferences

Download Paper

https://doi.org/10.1007/978-3-031-35995-8_17

Local Download

Keywords

agent-based modeling, machine learning, calibration

Citation

Olsen, M. , Raunak, M. and Kuhn, D. (2023), Predicting ABM Results with Covering Arrays and Random Forests, Computational Science – ICCS 2023. Lecture Notes in Computer Science, Prague, CZ, [online], https://doi.org/10.1007/978-3-031-35995-8_17, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=936514 (Accessed May 1, 2024)