Home

Available Tools


1. CATS (Constrained Array Test System) *) [Sherwood] Bell Labs.
2. OATS (Orthogonal Array Test System) *) [Phadke] AT&T
3. AETG Telecordia Web-based, commercial
4. IPO (PairTest) *) [Tai/Lei]
5. TConfig [Williams] Java-applet
6. TCG (Test Case Generator) *) NASA
7. AllPairs Satisfice Perl script, free, GPL
8. Pro-Test SigmaZone GUI, commercial
9. CTS (Combinatorial Test Services) IBM Free for non-commercial use
10. Jenny [Jenkins] Command-line, free, public-domain
11. ReduceArray2 STSC, U.S. Air Force Spreadsheet-based, free
12. TestCover Testcover.com Web-based, commercial
13. DDA *) [Colburn/Cohen/Turban]
14. Test Vector Generator GUI, free
15. OA1 k sharp technology
16. CTE-XL Berner & Mattner GUI, free
17. AllPairs [McDowell] Command-line, free
18. Intelligent Test Case Handler (replaces CTS) IBM Free for non-commercial use
19. CaseMaker Díaz & Hilterscheid GUI, commercial
20. PICT Microsoft Corp. Command-line, free
21. rdExpert Phadke Associates, Inc.
22. OATSGen *) Motorola
23. SmartTest Smartware Technologies Inc. GUI, commercial
24. EXACT *) [Yan/Zhang]
25. AllPairs MetaCommunications Free
26. ATD AtYourSide Consulting GUI, commercial
27. ACTS [formerly: FireEye] NIST GUI
28. Bender RBT Inc. BenderRBT GUI, commercial
29. Pairwise Test Case Generator TestersDesk Web-based
30. Combo-Test The Australian eHealth Research Centre Command-line, free
31. IPO-s *) [Calvagna/Gargantini]
32. VPTAG [Robert Vanderwall]
33. SpecExplorer Microsoft Corp. GUI, free
34. IBM Functional Coverage Unified Solution IBM GUI, commercial
35. CombTestWeb Universidad de Castilla-La Mancha Web-based, free
36. Hexawise Hexawise Web-based, free & commercial
37. PictMaster IWATSU System & Software Spreadsheet-based, free
38. NTestCaseBuilder [Murphy] .NET library
39. tcases [Kimbrough] Command-line, free

*) Not known to be available publicly



Comparison of Efficiency

The number of test cases produced by different tools for the same model:

Parameter Sizes AETG 1) IPO 2) TConfig 3) CTS 4) Jenny 5) TestCover 6) DDA 7) AllPairs [McDowell] 5) PICT EXACT8) IPO-s 9)
34 9 9 9 9 11 9 ? 9 9 9 9
313 15 17 15 15 18 15 18 17 18 15 17
415 317 229 41 34 40 39 38 29 35 34 37 ? 32
41 339 235 28 26 30 29 28 21 27 26 27 21 23
2100 10 15 14 10 16 10 15 14 15 10 10
1020 180 212 231 210 193 181 201 197 210 ? 220

1) Y. Lei and K. C. Tai In-parameter-order: a test generation strategy for pairwise testing, p. 8.
2) K. C. Tai and Y. Lei A Test Generation Strategy for Pairwise Testing, p. 2.
3) A. W. Williams Determination of Test Configurations for Pair-wise Interaction Coverage, p. 15.
4) A. Hartman and L. Raskin Problems and Algorithms for Covering Arrays, p. 11.
5) Supplied by Bob Jenkins.
6) Supplied by George Sherwood.
7) C. J. Colbourn, M. B. Cohen, R. C. Turban A Deterministic Density Algorithm for Pairwise Interaction Coverage, p. 6.
8) J. Yan, J. Zhang Backtracking Algorithms and Search Heuristics to Generate Test Suites for Combinatorial Testing, p. 8.
9) A. Calvagna, A. Gargantini IPO-s: Incremental Generation of Combinatorial Interaction Test Data Based on Symmetries of Covering Arrays, p. 17.




Need assistance introducing pairwise testing techniques at your company?
I can help. Email me or DM @jacekcz