Join me and my fellow combinatorial testing researchers and enthusiasts at the 6h International Workshop on Combinatorial Testing
held on March 13th, 2017 in Tokyo. More information on attending and opportunities to present are at: http://iwct2017.sba-research.org/
1. CATS (Constrained Array Test System) *) [Sherwood] Bell Labs.
2. OATS (Orthogonal Array Test System) *) [Phadke] ATT
3. AETG Telecordia Web-based, commercial
4. IPO (PairTest) *) [Tai/Lei]
5. TConfig [Williams] Java-applet
6. TCG (Test Case Generator) *) NASA
7. AllPairs Satisfice Perl script, free, GPL
8. Pro-Test SigmaZone GUI, commercial
9. CTS (Combinatorial Test Services) IBM Free for non-commercial use
10. Jenny [Jenkins] Command-line, free, public-domain
11. ReduceArray2 STSC, U.S. Air Force Spreadsheet-based, free
12. TestCover Testcover.com Web-based, commercial
13. DDA *) [Colburn/Cohen/Turban]
14. Test Vector Generator GUI, free
15. OA1 k sharp technology
16. CTE-XL Berner & Mattner GUI, free
17. AllPairs [McDowell] Command-line, free
18. Intelligent Test Case Handler (replaces CTS) IBM Free for non-commercial use
19. CaseMaker Díaz & Hilterscheid GUI, commercial
20. PICT Microsoft Corp. Command-line, open source at http://github.com/microsoft/pict
21. rdExpert Phadke Associates, Inc.
22. OATSGen *) Motorola
23. SmartTest Smartware Technologies Inc. GUI, commercial
24. EXACT *) [Yan/Zhang]
25. AllPairs MetaCommunications Free
26. ATD AtYourSide Consulting GUI, commercial
27. ACTS [formerly: FireEye] NIST GUI
28. Bender RBT Inc. BenderRBT GUI, commercial
29. Pairwise Test Case Generator TestersDesk Web-based
30. Combo-Test The Australian eHealth Research Centre Command-line, free
31. IPO-s *) [Calvagna/Gargantini]
32. VPTAG [Robert Vanderwall]
33. SpecExplorer Microsoft Corp. GUI, free
34. IBM Functional Coverage Unified Solution IBM GUI, commercial
35. CombTestWeb Universidad de Castilla-La Mancha Web-based, free
36. Hexawise Hexawise Web-based, free & commercial
37. PictMaster IWATSU System & Software Spreadsheet-based, free
38. NTestCaseBuilder [Murphy] .NET library
39. tcases [Kimbrough] Command-line, free
40. Pairwiser Inductive AS Web-based, free & commercial
41. NUnit Poole et al Unit test framework
42. ecFeed ecFeed AS Standalone, Eclipse plug-in, and jUnit runner

*) Not known to be available publicly

The number of test cases produced by different tools for the same model:

Model AETG 1) IPO 2) TConfig 3) CTS 4) Jenny 5) TestCover 6) DDA 7) AllPairs [McDowell] 5) PICT EXACT8) IPO-s 9) ecFeed 10)
34 9 9 9 9 11 9 ? 9 9 9 9 10
313 15 17 15 15 18 15 18 17 18 15 17 19
415 317 229 41 34 40 39 38 29 35 34 37 ? 32 37
41 339 235 28 26 30 29 28 21 27 26 27 21 23 28
2100 10 15 14 10 16 10 15 14 15 10 10 16
1020 180 212 231 210 193 181 201 197 210 ? 220 203

1) Y. Lei and K. C. Tai In-parameter-order: a test generation strategy for pairwise testing, p. 8.
2) K. C. Tai and Y. Lei A Test Generation Strategy for Pairwise Testing, p. 2.
3) A. W. Williams Determination of Test Configurations for Pair-wise Interaction Coverage, p. 15.
4) A. Hartman and L. Raskin Problems and Algorithms for Covering Arrays, p. 11.
5) Supplied by Bob Jenkins.
6) Supplied by George Sherwood.
7) C. J. Colbourn, M. B. Cohen, R. C. Turban A Deterministic Density Algorithm for Pairwise Interaction Coverage, p. 6.
8) J. Yan, J. Zhang Backtracking Algorithms and Search Heuristics to Generate Test Suites for Combinatorial Testing, p. 8.
9) A. Calvagna, A. Gargantini IPO-s: Incremental Generation of Combinatorial Interaction Test Data Based on Symmetries of Covering Arrays, p. 17.
10) Supplied by Patryk Chamuczynski.


Maintained by Jacek Czerwonka, Last updated: October 2016