[Version Information]
Phase2 (IST-Java-ICRA) WALi-OpenNWA version: be2c095cbf8ea078087a03cba4c7b85ea673fca0 (2017-07-05 19:28:46 -0400) "Updated frankensuite to avoid integer overflow"
Phase2 (IST-Java-ICRA) duet version: 393b2fa15ae67d4cf44b9a72bd4e0c54307ef649 (2017-05-16 13:07:27 -0400) "Updated the costs for thread.sleep from 10 to 1000"

Phase3 WALi-OpenNWA version: be2c095cbf8ea078087a03cba4c7b85ea673fca0 (2017-07-05 19:28:46 -0400) "Updated frankensuite to avoid integer overflow"
Phase3 duet version: 37312f93042d9322883c425e7b53f0a32ea6ba3b (2017-07-05 19:03:26 -0400) "Big O bounds in print_hull"
# Installed packages for 4.02.1+PIC:
apron              20160125  APRON numerical abstract domain library
base-bigarray          base  Bigarray library distributed with the OCaml compile
base-bytes             base  Bytes library distributed with the OCaml compiler
base-num               base  Num library distributed with the OCaml compiler
base-ocamlbuild        base  OCamlbuild binary and libraries distributed with th
base-threads           base  Threads library distributed with the OCaml compiler
base-unix              base  Unix library distributed with the OCaml compiler
batteries             2.5.3  a community-maintained standard library extension
camlidl                1.05  Stub code generator for OCaml
camlp4               4.02+7  Camlp4 is a system for writing extensible parsers f
cil                20150825  A front-end for the C programming language that fac
conf-gmp                  1  Virtual package relying on a GMP lib system install
conf-m4                   1  Virtual package relying on m4
conf-mathsat              1  Virtual package relying on a MathSAT system install
conf-mpfr                 1  Virtual package relying on library MPFR installatio
conf-perl                 1  Virtual package relying on perl
conf-python-2-7         1.0  Virtual package relying on Python-2.7 installation.
conf-which                1  Virtual package relying on which
cppo                  1.4.1  Equivalent of the C preprocessor for OCaml programs
deriving           20140904  Extension to OCaml for deriving functions from type
mathsat            20161206  MathSAT 5 SMT solver
menhir             20170101  LR(1) parser generator
mlgmpidl              1.2.4  OCaml interface to the GMP library
num                       0  The Num library for arbitrary-precision integer and
oasis                 0.4.8  Tooling for building OCaml libraries and applicatio
ocamlbuild                0  Build system distributed with the OCaml compiler si
ocamlfind             1.7.1  A library manager for OCaml
ocamlgraph            1.8.7  A generic graph library for OCaml
ocamlify              0.0.1  Include files in OCaml code
ocamlmod              0.0.8  Generate OCaml modules from source files
OCRS             20170627v3  Recurrence solver based on operational calculus
optcomp                 1.6  Optional compilation with cpp-like directives
ounit                 2.0.0  Unit testing framework loosely based on HUnit. It i
ppx_deriving            4.1  Type-driven code generation for OCaml >=4.02
ppx_tools        5.0+4.02.0  Tools for authors of ppx rewriters and other syntac
result                  1.2  Compatibility Result module
Z3                 20161217  Z3 SMT solver

Test Name Output Duet Output No. of Rounds Result
/bat0/stac/Code/Java-benchmarks/java_package/quick_java_examples/
Degree1Monomial.java output 1 12.546
Degree2Monomial.java output 1 12.119
Degree3Monomial.java output 1 11.897
Degree4Monomial.java output 1 12.17
Degree5Monomial.java output 1 17.632
Total Below Time = 66.364 (was 72.212)
/bat0/stac/Code/Java-benchmarks/java_package/simple_java_examples/
SimpleDegree1Monomial.java output 1 10.7
SimpleDegree2Monomial.java output 1 10.665
SimpleDegree3Monomial.java output 1 10.727
SimpleDegree4Monomial.java output 1 10.897 (12.124)
SimpleDegree5Monomial.java output 1 13.774
Total Below Time = 56.763 (was 61.389)
/bat0/stac/Code/Java-benchmarks/java_package/selected_canonical/
Category2.java output 1 12.367 (13.795)
Category7.java output 1 12.773 (14.234)
Category8.java output 4 13.807 (15.445)
Total Below Time = 38.947 (was 43.474)
/bat0/stac/Code/Java-benchmarks/java_package/new-canonical-examples/all_canonical_jars/
Category10_not_vulnerable.java output 1 13.425
Category10_vulnerable.java output 1 13.49
Category11_Case_A_vulnerable.java output 3 29.532
Category11_Case_B_vulnerable.java output 3 28.223
Category12_not_vulnerable_exception.java output 4 35.265 (39.585)
Category12_vulnerable_conditional.java output 4 30.426
Category12_vulnerable_exception.java output 4 36.156
Category1_not_vulnerable.java output 1 12.491
Category1_vulnerable.java output 1 12.992
Category2_vulnerable.java output 1 12.76
Category3_not_vulnerable.java output 1 12.744
Category3_vulnerable.java output 1 12.761
Category4_not_vulnerable.java output 4 299.692
Category4_vulnerable.java output 4 218.506 (253.92)
Category5_vulnerable.java output 1 13.487 (15.451)
Category6_not_vulnerable.java output 4 31.746
Category6_vulnerable.java output 4 34.596 (38.567)
Category7_vulnerable.java output 1 12.917
Category8_vulnerable.java output 4 14.132
Category9_vulnerable.java output 1 12.652
Total Below Time = 887.993 (was 960.35)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA//Examples/cprover/tests/java/abstraction_ladder_1/
AL1_Category10_vulnerable.java output 1 13.285
AL1_Category1_vulnerable.java output 1 12.641
AL1_Category8_vulnerable.java output 4 14.075
AL1_Category9_vulnerable.java output 1 13.197
Alphabetical_Order.java output 3 14.619
Karatsuba.java output TIMEOUT
300.006
StringAbs.java output 1 12.433
Total Below Time = 380.256 (was 387.142)

>25% better
25%-10% better
No significant change
10%-25% worse
>25% worse