Running the evaluation

Bash scripts

We wrote bash scripts to simplify the run of the evaluation. They are available in the folder evaluation-scripts of the tool suite.

generate-all generates 10 OSGi bundles each with the java code for 10 generated metamodels
run-all takes generated OSGi bundle as arguments, and run the evaluation for both 1 clone and 1000 clones
plot-all takes generated CSV files as arguments, and created many plots to visualize the results

They can be easily run in a linux environement, but also in a Windows environment using win-bash.

cd /path/to/evaluation-scripts
./generate-all

A folder benchmarktool-workingdir is created, in which will be created 10 OSGi bundles named bundle1.jar, bundle2.jar, etc.

./run-all benchmarktool-workingdir/*.jar

The evaluation starts, and eventually creates CSV files in benchmarktool-workingdir.

./plot-all benchmarktool-workingdir/*.csv

R is called to plot the data, and PDF files are created in benchmarktool-workingdir.