iwct2014 Paolo Arcaini Angelo Gargantini Paolo Vavassori

Validation of Models and Tests for Constrained Combinatorial Interaction Testing

in The 3rd International Workshop on Combinatorial Testing (IWCT 2014) In conjunction with IEEE International Conference on Software Testing (ICST 2014, March 31 - April 4) (2014): 98-107

In Combinatorial Interaction Testing, models specify a set of parameters with associated domains, and some constraints over the parameters. Test generation tools produce, starting from these models, test suites for achieving some given coverage criteria. The validation of both the models and the produced test suites is a worthwhile activity. Validating the models permits to early discover possible defects in them, to feed the test generations tools with good inputs and, possibly, to improve the quality of the testing process. Validating the produced test suites, instead, permits to check if the test generation tools are correct and to judge their quality. This paper proposes to validate the models by checking that the constraints are consistent, that there is no constraint implied by the other constraints, and that the parameters and their values are really necessary. The proposed test suite validation, instead, consists in checking that the tests respect the type definitions and the constraints, that all the test requirements are covered, and that no unnecessary test is present in the test suite.

[download the pdf file] [DOI] [presentation]

My sw links