Experimental stuff corresponding to the article:

Experimental stuff corresponding to the article:

Decreasing the cost of mutation testing with 2-order mutants

Macario Polo, Mario Piattini and Ignacio García-Rodríguez

University of Castilla-La Mancha

Paseo de la Universidad, 4

13071-Ciudad Real (Spain)

Tel.: +34.902.204.100

Abstract.

This website contains links to the experimental stuff mentioned in the article. You can download all the stuff to replicate the experiments, extract new conclusions, etc.

1. Tools used in the experiment.

MuJava: available at http://ise.gmu.edu/~ofut/mujava/

testooj: available at http://alarcos.inf-cr.uclm.es/testooj3

2. Benchmark programs.

Through the links in the following tables, you can download:

Source code of the benchmark programs
1-order mutants (packed in jar files)
2-order mutants, generated with the three algorithms described in the paper (packed in jar files)
Test suites in MuJava/testooj format
1-order killing matrixes (in Microsoft Excel format)
2-order killing matrixes (in Microsoft Excel format) only for the DifferentOperators algorithm

Take into account that killing matrixes do not show alive mutants.

Program	Source code	1-order mutants	2-order mutants
Program	Source code	1-order mutants	DifferentOperators	LastToFirst	RandomMix
Bisect	Bisect.java	paper.Bisect.rar	paper.Bisect.rar	paper.Bisect.rar	paper.Bisect.rar
Bub	BubCorrecto.java	paper.BubCorrecto.rar	paper.BubCorrecto.rar	paper.BubCorrecto.rar	paper.BubCorrecto.rar
Find	Find.java	paper.Find.rar	paper.Find.rar	paper.Find.rar	paper.Find.rar
Fourballs	Fourballs.java	paper.Fourballs.rar	paper.Fourballs.rar	paper.Fourballs.rar	paper.Fourballs.rar
Mid	Mid.java	paper.Mid.rar	paper.Mid.rar	paper.Mid.rar	paper.Mid.rar
TriTyp	Triangulo.java	paper.Triangulo.rar	paper.Triangulo.rar	paper.Triangulo.rar	paper.Triangulo.rar

Program	Test suites		Killing matrixes (in Microsoft Excel format)
	Test suites		Original suite		Reduced suite
	Original	Reduced	1-order	2-order (only for DifferentOperators)	1-order	2-order (only for DifferentOperators)
Bisect	MBisectOK.java	MBisectOKR.java	MBisectOK.xls	MBisectOK.xls	MBisectOKR.xls	MBisectOKR.xls
Bub	MBubCorrectoOK.java	MBubCorrectoOKR.java	MBubCorrectoOK.xls	MBubCorrectoOK.xls	MBubCorrectoOKR.xls	MBubCorrectoOKR.xls
Find	MFindOK.java	MFindOKR.java	MFindOK.xls	MFindOK.xls	MFindOKR.xls	MFindOKR.xls
Fourballs	MFourballsOK.java	MFourballsOKR.java	MFourballsOK.xls	MFourballsOK.xls	MFourballsOKR.xls	MFourballsOKR.xls
Mid	MMidOK.java	MMidOKR.java	MMidOK.xls	MMidOK.xls	MMidOKR.xls	MMidOKR.xls
TriTyp	MTrianguloOK.java	MTrianguloOKR.java	MTrianguloOK.xls	MTrianguloOK.xls	MTrianguloOKR.xls	MTrianguloOKR.xls

3. Industrial programs.

In the links of the following tables, you can find:

Links to the source code of the industrial programs. Take into account that these programs are included into three big projects with many classes and configuration files, and maybe is not trivial to run them. The projects also contain JUnit test cases, which have been used to get the corresponding MuJava/testooj test cases.
1-order mutants (packed in jar files)
2-order mutants generated only with the DifferentOperators algorithm (packed in jar files)
Test cases in JUnit format.
Test cases in MuJava/testooj format.
1-order killing matrixes (in Microsoft Excel format)
2-order killing matrixes (in Microsoft Excel format) only for the DifferentOperators algorithm

Take into account that killing matrixes do not show alive mutants.

Program	Source code	1-order mutants	2-order mutants
Program	Source code	1-order mutants	DifferentOperators
Ciudad	http://www.inf-cr.uclm.es/www/mpolo/trafico	dominio.Ciudad.rar	dominio.Ciudad.rar
IgnoreList	http://jester.sourceforge.net	jester.IgnoreList.rar	jester.IgnoreList.rar
PluginTokenizer	http://sir.unl.edu/php/index.php (requires login)	de.susebox.jtopas.PluginTokenizer.rar	de.susebox.jtopas.PluginTokenizer.rar

Program	Test cases in JUnit format	Test cases in MuJava/testooj format	1-order killing matrixes (in Microsoft Excel format)	2-order killing matrixes (in Microsoft Excel format)
Ciudad	CiudadTester.java	MujavaCiudad.java	MujavaCiudad.xls	MujavaCiudad.xls
IgnoreList	IgnoreListTest.java	MuJavaIgnoreList.java	MuJavaIgnoreList.xls	MuJavaIgnoreList.xls
PluginTokenizer	CiudadTester.java	MuJavaPluginTokenizer.java	MuJavaPluginTokenizer.xls	MuJavaPluginTokenizer.xls

3. Ackowledgments.

This work is partially supported by the ENIGMAS (Junta de Comunidades de Castilla-La Mancha, PBI-05-058), FAMOSO (Ministerio de Industria, Turismo y Comercio FIT-340000-2005-161) and ESFINGE (Ministerio de Educación y Ciencia/FEDER, TIN2006-15175-C05-05) projects.