Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Combinatorial Testing of ACTS: A Case Study

Published

Author(s)

Mehra N. Borazjany, Linbin Yu, Yu Lei, Raghu N. Kacker, D. Richard Kuhn

Abstract

In this paper we present a case study of applying combinatorial testing to test a combinatorial test generation tool called ACTS. The purpose of this study is two-fold. First, we want to gain experience and insights about how to apply combinatorial testing in practice. Second, we want to evaluate the effectiveness of combinatorial testing applied to a real-life system. ACTS has 24637 lines of uncommented code, and provides a command line interface and a fairly sophisticated graphic user interface. The main challenge of this study was to model the input space in terms of a set of parameters and values. Once the model was designed, we generated test cases using ACTS, which were then later used to test ACTS. The results of this study show that input space modeling can be a significant undertaking, and needs to be carefully managed. The results also show that combinatorial testing is effective in terms of achieving high code coverage and fault detection.
Proceedings Title
Proceedings of the IEEE Fifth International Conference on Software, Testing, Verification and Validation (ICST 2012)
Conference Dates
April 17-21, 2012
Conference Location
Montreal , CA
Conference Title
First International Workshop on Combinatorial Testing

Keywords

Combinatorial Testing, Input Parameter Modeling, Software Testing

Citation

Borazjany, M. , Yu, L. , Lei, Y. , Kacker, R. and Kuhn, D. (2012), Combinatorial Testing of ACTS: A Case Study, Proceedings of the IEEE Fifth International Conference on Software, Testing, Verification and Validation (ICST 2012), Montreal , CA, [online], https://doi.org/10.1109/ICST.2012.146 (Accessed July 4, 2022)
Created April 20, 2012, Updated October 12, 2021