Available Tools
| 1.
|
CATS (Constrained Array Test System)
*)
|
[Sherwood] Bell Labs.
|
|
|
| 2.
|
OATS (Orthogonal Array Test System)
*)
|
[Phadke] AT&T
|
|
|
| 3.
|
AETG
|
Telecordia
|
Web-based, commercial
|
|
| 4.
|
IPO (PairTest)
*)
|
[Tai/Lei]
|
|
|
| 5.
|
TConfig
|
[Williams]
|
Java-applet
|
|
| 6.
|
TCG (Test Case Generator)
*)
|
NASA
|
|
|
| 7.
|
AllPairs
|
Satisfice
|
Perl script, free, GPL
|
|
| 8.
|
Pro-Test
|
SigmaZone
|
GUI, commercial
|
|
| 9.
|
CTS (Combinatorial Test Services)
|
IBM
|
Free for non-commercial use
|
|
| 10.
|
Jenny
|
[Jenkins]
|
Command-line, free, public-domain
|
|
| 11.
|
ReduceArray2
|
STSC, U.S. Air Force
|
Spreadsheet-based, free
|
|
| 12.
|
TestCover
|
Testcover.com
|
Web-based, commercial
|
|
| 13.
|
DDA
*)
|
[Colburn/Cohen/Turban]
|
|
|
| 14.
|
Test Vector Generator
|
|
GUI, free
|
|
| 15.
|
OA1
|
k sharp technology
|
|
|
| 16.
|
CTE-XL
|
Berner & Mattner
|
GUI, free
|
|
| 17.
|
AllPairs
|
[McDowell]
|
Command-line, free
|
|
| 18.
|
Intelligent Test Case Handler (replaces CTS)
|
IBM
|
Free for non-commercial use
|
|
| 19.
|
CaseMaker
|
Díaz & Hilterscheid
|
GUI, commercial
|
|
| 20.
|
PICT
|
Microsoft Corp.
|
Command-line, free
|
|
| 21.
|
rdExpert
|
Phadke Associates, Inc.
|
|
|
| 22.
|
OATSGen
*)
|
Motorola
|
|
|
| 23.
|
SmartTest
|
Smartware Technologies Inc.
|
GUI, commercial
|
|
| 24.
|
EXACT
*)
|
[Yan/Zhang]
|
|
|
| 25.
|
AllPairs
|
MetaCommunications
|
Free
|
|
| 26.
|
ATD
|
AtYourSide Consulting
|
GUI, commercial
|
|
| 27.
|
ACTS [formerly: FireEye]
|
NIST
|
GUI
|
|
| 28.
|
Bender RBT Inc.
|
BenderRBT
|
GUI, commercial
|
|
| 29.
|
Pairwise Test Case Generator
|
TestersDesk
|
Web-based
|
|
| 30.
|
Combo-Test
|
The Australian eHealth Research Centre
|
Command-line, free
|
|
| 31.
|
IPO-s
*)
|
[Calvagna/Gargantini]
|
|
|
| 32.
|
VPTAG
|
[Robert Vanderwall]
|
|
|
| 33.
|
SpecExplorer
|
Microsoft Corp.
|
GUI, free
|
|
| 34.
|
IBM Functional Coverage Unified Solution
|
IBM
|
GUI, commercial
|
|
| 35.
|
CombTestWeb
|
Universidad de Castilla-La Mancha
|
Web-based, free
|
|
| 36.
|
Hexawise
|
Hexawise
|
Web-based, free & commercial
|
|
| 37.
|
PictMaster
|
IWATSU System & Software
|
Spreadsheet-based, free
|
yes
|
*) Not known to be available publicly
Comparison of Efficiency
The number of test cases produced by different tools for the same model:
| Parameter Sizes |
AETG 1) |
IPO 2) |
TConfig 3) |
CTS 4) |
Jenny 5) |
TestCover 6) |
DDA 7) |
AllPairs [McDowell] 5) |
PICT |
EXACT8) |
IPO-s 9) |
| 34 |
9 |
9 |
9 |
9 |
11 |
9 |
? |
9 |
9 |
9 |
9 |
| 313 |
15 |
17 |
15 |
15 |
18 |
15 |
18 |
17 |
18 |
15 |
17 |
| 415 317 229 |
41 |
34 |
40 |
39 |
38 |
29 |
35 |
34 |
37 |
? |
32 |
| 41 339 235 |
28 |
26 |
30 |
29 |
28 |
21 |
27 |
26 |
27 |
21 |
23 |
| 2100 |
10 |
15 |
14 |
10 |
16 |
10 |
15 |
14 |
15 |
10 |
10 |
| 1020 |
180 |
212 |
231 |
210 |
193 |
181 |
201 |
197 |
210 |
? |
220 |
1) Y. Lei and K. C. Tai In-parameter-order: a test generation strategy for pairwise testing, p. 8.
2) K. C. Tai and Y. Lei A Test Generation Strategy for Pairwise Testing, p. 2.
3) A. W. Williams Determination of Test Configurations for Pair-wise Interaction Coverage, p. 15.
4) A. Hartman and L. Raskin Problems and Algorithms for Covering Arrays, p. 11.
5) Supplied by Bob Jenkins.
6) Supplied by George Sherwood.
7) C. J. Colbourn, M. B. Cohen, R. C. Turban A Deterministic Density Algorithm for Pairwise Interaction Coverage, p. 6.
8) J. Yan, J. Zhang Backtracking Algorithms and Search Heuristics to Generate Test Suites for Combinatorial Testing, p. 8.
9) A. Calvagna, A. Gargantini IPO-s: Incremental Generation of Combinatorial Interaction Test Data Based on Symmetries of Covering Arrays, p. 17.
Need assistance introducing pairwise testing techniques at your company?
I can help. Email me or DM @jacekcz
|