NOTICE: Due to a lapse in annual appropriations, most of this website is not being updated. Learn more.
Form submissions will still be accepted but will not receive responses at this time. Sections of this site for programs using non-appropriated funds (such as NVLAP) or those that are excepted from the shutdown (such as CHIPS and NVD) will continue to be updated.
An official website of the United States government
Here’s how you know
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models
Published
Author(s)
M S Raunak, Megan Olsen
Abstract
Metamorphic testing has been shown to be useful in testing "non-testable" programs in many domains. Modeling & simulation is one such domain, where both verification and validation can be difficult due to lack of oracles. Although the definition of verification and validation vary slightly in modeling and simulation when compared to standard software, we show that metamorphic testing is appropriate in both steps of ensuring that a simulation model is accurate. In this paper we expand on our five years of prior work on metamorphic testing for simulation validation to show how metamorphic testing can be used for verification as well, and how the previously defined guidelines for validation can be utilized in eliciting metamorphic relations for verification.
Proceedings Title
IEEE/ACM 6th International Workshop on Metamorphic Testing (MET)
Raunak, M.
and Olsen, M.
(2021),
Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models, IEEE/ACM 6th International Workshop on Metamorphic Testing (MET), Madrid, ES, [online], https://doi.org/10.1109/MET52542.2021.00015, https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=931851
(Accessed October 13, 2025)