Optimization of validation test suite coverage

Test coverage is an important aspect of a validation suite for implementations of a standard such as the CAIS. This paper presents the development and application of a constrained optimization process for CAIS test coverage. Subjective criteria and goals combined with objective measures of test coverage derived from information models yield a quasi-quantitative figure of merit for test objectives. The approach next identifies resource (time and effort) and process constraints. A greedy algorithm provides a partial solution to the coverage design problem. The decreasing first fit bin packing heuristic then refines the coverage measure of the validation test suite within the process constraints. Finally, the paper presents the results of the application test selection and optimization process to the design of the CIVC-A test suite.