[Version Information]
Phase2 (IST-Java-ICRA) WALi-OpenNWA version: cb66c5d81a7461250a11c7d2e8f839a3ac4b693b (2017-06-01 11:48:21 -0500) "Allow full_icra_rebuild.sh to work with both NewtonICRA duet and Newton-ark2 duet."
Phase2 (IST-Java-ICRA) duet version: 393b2fa15ae67d4cf44b9a72bd4e0c54307ef649 (2017-05-16 13:07:27 -0400) "Updated the costs for thread.sleep from 10 to 1000"

Phase3 WALi-OpenNWA version: cb66c5d81a7461250a11c7d2e8f839a3ac4b693b (2017-06-01 11:48:21 -0500) "Allow full_icra_rebuild.sh to work with both NewtonICRA duet and Newton-ark2 duet."
Phase3 duet version: 3f3626cb91d25fac166f7330b2ef6994712067de (2017-06-14 18:23:52 -0400) "Merge remote-tracking branch 'origin/ark2' into Newton-ark2"
# Installed packages for 4.02.1+PIC:
apron              20160125  APRON numerical abstract domain library
base-bigarray          base  Bigarray library distributed with the OCaml compile
base-bytes             base  Bytes library distributed with the OCaml compiler
base-ocamlbuild        base  OCamlbuild binary and libraries distributed with th
base-threads           base  Threads library distributed with the OCaml compiler
base-unix              base  Unix library distributed with the OCaml compiler
batteries             2.5.3  a community-maintained standard library extension
camlidl                1.05  Stub code generator for OCaml
camlp4               4.02+7  Camlp4 is a system for writing extensible parsers f
cil                20150825  A front-end for the C programming language that fac
conf-gmp                  1  Virtual package relying on a GMP lib system install
conf-m4                   1  Virtual package relying on m4
conf-mathsat              1  Virtual package relying on a MathSAT system install
conf-mpfr                 1  Virtual package relying on library MPFR installatio
conf-perl                 1  Virtual package relying on perl
conf-python-2-7         1.0  Virtual package relying on Python-2.7 installation.
conf-which                1  Virtual package relying on which
cppo                  1.4.1  Equivalent of the C preprocessor for OCaml programs
deriving           20140904  Extension to OCaml for deriving functions from type
mathsat            20161206  MathSAT 5 SMT solver
menhir             20170101  LR(1) parser generator
mlgmpidl              1.2.4  OCaml interface to the GMP library
oasis                 0.4.8  Tooling for building OCaml libraries and applicatio
ocamlbuild                0  Build system distributed with the OCaml compiler si
ocamlfind             1.7.1  A library manager for OCaml
ocamlgraph            1.8.7  A generic graph library for OCaml
ocamlify              0.0.1  Include files in OCaml code
ocamlmod              0.0.8  Generate OCaml modules from source files
OCRS               20170323  Recurrence solver based on operational calculus
optcomp                 1.6  Optional compilation with cpp-like directives
ounit                 2.0.0  Unit testing framework loosely based on HUnit. It i
ppx_deriving            4.1  Type-driven code generation for OCaml >=4.02
ppx_tools        5.0+4.02.0  Tools for authors of ppx rewriters and other syntac
result                  1.2  Compatibility Result module
Z3                 20161217  Z3 SMT solver

Test Name Output No. of Rounds Result Time (Prev.)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/c4b
gcd.c [OCRS][without] 1 FAIL
0.383 (0.346)
kmp.c [OCRS][without] 1 PASS
1.394 (1.121)
qsort.c [OCRS][without] 5 PASS
3.719 (1.955)
speed_pldi09_fig1.c [OCRS][without] 1 PASS
0.392 (0.346)
speed_pldi09_fig4_2.c [OCRS][without] 1 FAIL
0.414 (0.368)
speed_pldi09_fig4_4.c [OCRS][without] 1 PASS
0.482 (0.426)
speed_pldi09_fig4_5.c [OCRS][without] 1 PASS
0.387 (0.349)
speed_pldi10_ex1.c [OCRS][without] 1 PASS
4.07 (0.771)
speed_pldi10_ex3.c [OCRS][without] 1 PASS
0.473
speed_pldi10_ex4.c [OCRS][without] EXCEPTION
0.409
speed_popl10_fig2_1.c [OCRS][without] 1 PASS
0.426 (0.374)
speed_popl10_fig2_2.c [OCRS][without] 1 FAIL
0.396
speed_popl10_nested_multiple.c [OCRS][without] 1 PASS
0.443
speed_popl10_nested_single.c [OCRS][without] 1 PASS
0.418
speed_popl10_sequential_single.c [OCRS][without] 1 PASS
0.37
speed_popl10_simple_multiple.c [OCRS][without] 1 PASS
0.394
speed_popl10_simple_single_2.c [OCRS][without] 1 PASS
0.434
speed_popl10_simple_single.c [OCRS][without] 1 PASS
0.35
t07.c [OCRS][without] 1 PASS
0.381
t08.c [OCRS][without] 1 PASS
0.368
t09.c [OCRS][without] 1 PASS
0.377
t10.c [OCRS][without] 1 PASS
0.377 (0.329)
t11.c [OCRS][without] 1 PASS
0.393
t13.c [OCRS][without] 1 FAIL
0.41
t15.c [OCRS][without] 1 PASS
0.39
t16.c [OCRS][without] 1 PASS
0.372
t19.c [OCRS][without] 1 PASS
0.376
t20.c [OCRS][without] 1 PASS
0.372 (0.334)
t27.c [OCRS][without] 1 PASS
0.43 (0.377)
t28.c [OCRS][without] 1 PASS
0.41 (0.363)
t30.c [OCRS][without] 1 FAIL
0.377 (0.335)
t37.c [OCRS][without] 2 PASS
0.503
t39.c [OCRS][without] 2 PASS
0.504
t46.c [OCRS][without] 1 PASS
0.364
t47.c [OCRS][without] 1 PASS
0.367
Total Below Time = 22.125 (was 15.75)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/misc-recursive
mult-rec.c [OCRS][without] 2 PASS
PASS
0.388
qsort_full.c [OCRS][without] 5 TIMEOUT
300.01 (41.615)
rec1-param_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.388 (0.332)
rec1-param_unsafe.c [OCRS][without] 2 PASS
0.38 (0.332)
rec1_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.354
rec1_unsafe.c [OCRS][without] 2 PASS
0.337
rec2-param_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.356
rec2-param_unsafe.c [OCRS][without] 2 PASS
0.348
rec2_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.33
rec2_unsafe.c [OCRS][without] 2 PASS
0.35
rec-test.c [OCRS][without] 2 PASS
0.35
sas03_bothbranches.c [OCRS][without] 7 PASS
1.356
sas03.c [OCRS][without] 2 PASS
0.829
simulated_lese_recursive.c [OCRS][without] 2 PASS
0.401
Total Below Time = 306.177 (was 47.359)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/duet
count_up_down_safe.c [OCRS][without] 1 PASS
0.333
count_up_down_unsafe.c [OCRS][without] 1 PASS
0.331
divide.c [OCRS][without] 1 PASS
0.341
factor_unsafe.c [OCRS][without] 1 PASS
0.332
for_infinite_loop_1_safe.c [OCRS][without] 1 PASS
0.336 (0.305)
for_infinite_loop_2_safe.c [OCRS][without] 1 PASS
0.31
interproc.c [OCRS][without] 1 PASS
0.321
mult.c [OCRS][without] 1 PASS
PASS
0.345
pointer_arith.c [OCRS][without] 1 PASS
PASS
PASS
PASS
0.331
quotient.c [OCRS][without] 3 PASS
0.432
subtract.c [OCRS][without] 1 PASS
0.338
sum01_bug02_sum01_bug02_base.case_unsafe.c [OCRS][without] 1 PASS
0.361 (0.328)
sum01_bug02_unsafe.c [OCRS][without] 1 PASS
0.407
sum01_real_safe.c [OCRS][without] 1 PASS
0.333
sum01_safe.c [OCRS][without] 1 PASS
0.33
sum01_unsafe.c [OCRS][without] 1 PASS
0.378
sum02_safe.c [OCRS][without] 1 PASS
0.342
sum03_safe.c [OCRS][without] 1 PASS
0.365
sum03_unsafe.c [OCRS][without] 1 PASS
0.433 (0.372)
sum04_safe.c [OCRS][without] 1 PASS
0.343
sum04_unsafe.c [OCRS][without] 1 PASS
0.395
terminator_02_safe.c [OCRS][without] 1 PASS
0.359 (0.322)
terminator_02_unsafe.c [OCRS][without] 1 PASS
0.358
terminator_03_safe.c [OCRS][without] 1 PASS
0.314
terminator_03_unsafe.c [OCRS][without] 1 PASS
0.352
token_ring01_safe.c [OCRS][without] TIMEOUT
300.007
token_ring01_unsafe.c [OCRS][without] TIMEOUT
300.007
toy_safe.c [OCRS][without] EXCEPTION
80.213 (160.307)
trex01_safe.c [OCRS][without] 1 PASS
0.5 (0.718)
trex01_unsafe.c [OCRS][without] 1 PASS
0.364
trex02_safe2.c [OCRS][without] 3 PASS
0.396
trex02_safe.c [OCRS][without] 3 PASS
0.374
trex02_unsafe.c [OCRS][without] 3 PASS
0.389
trex03_safe.c [OCRS][without] 1 PASS
0.454
trex03_unsafe.c [OCRS][without] 1 PASS
0.461 (0.404)
trex04_safe.c [OCRS][without] 1 PASS
0.359
while_infinite_loop_1_safe.c [OCRS][without] 1 PASS
0.316
while_infinite_loop_2_safe.c [OCRS][without] 1 PASS
0.301
while_infinite_loop_3_safe.c [OCRS][without] 1 PASS
0.324
Total Below Time = 693.285 (was 772.804)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests
above_litmus.c [OCRS][without] 3 PASS
0.454
blogger_simplified1.c [OCRS][without] 3 PASS
0.96
divided_difference2.c [OCRS][without] TIMEOUT
300.004
mult-proc.c [OCRS][without] 3 PASS
PASS
0.387 (0.339)
mult-proc-params.c [OCRS][without] 3 PASS
PASS
0.42
popall.c [OCRS][without] 1 PASS
PASS
PASS
PASS
PASS
0.437 (0.386)
simulated_scc.c [OCRS][without] 1 PASS
PASS
0.528
Total Below Time = 303.19 (was 302.989)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/polynomial/assert
degree1_monomial.c [OCRS][without] 1 PASS
0.359 (0.319)
degree2_binomial.c [OCRS][without] 1 PASS
0.486
degree2_monomial.c [OCRS][without] 1 PASS
0.397 (0.36)
degree3_binomial.c [OCRS][without] 1 PASS
0.936 (0.793)
degree3_monomial.c [OCRS][without] 1 PASS
0.421
degree4_binomial.c [OCRS][without] 1 PASS
1.194 (1.021)
degree4_monomial.c [OCRS][without] 1 PASS
0.505 (0.448)
degree5_binomial.c [OCRS][without] 1 PASS
1.781
degree5_monomial.c [OCRS][without] 1 PASS
0.581
Total Below Time = 6.66 (was 6.122)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/snlee/snlee_tests
cubic_with_square.c [OCRS][without] 1 PASS
0.353
cubic_with_square_interproc.c [OCRS][without] 2 PASS
0.391
cubic_with_square_nonlinear.c [OCRS][without] 1 PASS
0.373 (0.326)
cubic_with_square_nonlinear_interproc.c [OCRS][without] 2 PASS
0.383
cubic_with_square_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.388 (0.335)
cubic_with_square_unsafe.c [OCRS][without] 1 PASS
0.351
multi-input.c [OCRS][without] 1 PASS
0.408
multi-input_unsafe.c [OCRS][without] 1 PASS
0.43
nondet_loop_bound.c [OCRS][without] 1 PASS
0.36
nondet_loop_bound_quartic.c [OCRS][without] 1 PASS
0.374 (0.339)
nondet_loop_bound_quartic_unsafe.c [OCRS][without] 1 PASS
0.359
nondet_loop_bound_unsafe.c [OCRS][without] 1 PASS
0.379
nonlinear_stratified.c [OCRS][without] 1 FAIL
0.352
nonlinear_stratified_unsafe.c [OCRS][without] 1 PASS
0.341
quartic_with_cube.c [OCRS][without] 1 PASS
0.341
quartic_with_cube_nonlinear.c [OCRS][without] 1 PASS
0.375
quartic_with_cube_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.38
quartic_with_cube_unsafe.c [OCRS][without] 1 PASS
0.362
quintic_with_quartic.c [OCRS][without] 1 PASS
0.351
quintic_with_quartic_nonlinear.c [OCRS][without] 1 PASS
0.39
quintic_with_quartic_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.398 (0.444)
quintic_with_quartic_unsafe.c [OCRS][without] 1 PASS
0.372
Total Below Time = 8.211 (was 7.868)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/FiniteDifferencing
degree2.c [OCRS][without] 1 PASS
0.519
degree2_FD_AllAux_AllAssm.c [OCRS][without] 1 PASS
3.733 (2.92)
degree2_FD_AllAux_FewAssm.c [OCRS][without] 1 PASS
5.605 (2.912)
degree2_FD_FewAux_FewAssm.c [OCRS][without] 1 PASS
0.701
degree2_FD_FewAux_FewAssm_NonLinAsrt.c [OCRS][without] 1 PASS
0.745 (0.677)
degree3.c [OCRS][without] 1 PASS
0.54
degree3_FD.c [OCRS][without] 1 PASS
0.723
degree4.c [OCRS][without] 1 PASS
0.414
Total Below Time = 12.98 (was 9.283)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LESE
loop.c [OCRS][without] 1 PASS
0.378
loop_unsafe.c [OCRS][without] 1 PASS
0.413
simulated_lese_parser.c [OCRS][without] 1 PASS
0.326
simulated_lese_sentinel.c [OCRS][without] 1 PASS
0.331
Total Below Time = 1.448 (was 1.427)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LowerBound
lower_bound.c [OCRS][without] 1 PASS
PASS
PASS
0.331
Total Below Time = 0.331 (was 0.326)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LZ
lz77.c [OCRS][without] TIMEOUT
300.014
Total Below Time = 300.014 (was 300.006)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-acceleration
array_false-unreach-call1.c [OCRS][without] 1 PASS
0.338
array_false-unreach-call2.c [OCRS][without] 1 PASS
0.371
array_false-unreach-call3.c [OCRS][without] 1 PASS
0.335
array_true-unreach-call1.c [OCRS][without] 1 FAIL
0.35
array_true-unreach-call2.c [OCRS][without] 1 FAIL
0.371
array_true-unreach-call3.c [OCRS][without] 1 PASS
0.331
array_true-unreach-call4.c [OCRS][without] 1 FAIL
0.353
const_false-unreach-call1.c [OCRS][without] 1 PASS
0.337
const_true-unreach-call1.c [OCRS][without] 1 PASS
0.344 (0.301)
diamond_false-unreach-call1.c [OCRS][without] 1 PASS
0.349
diamond_true-unreach-call1.c [OCRS][without] 1 PASS
0.338
diamond_true-unreach-call2.c [OCRS][without] 1 PASS
0.395 (0.354)
functions_false-unreach-call1.c [OCRS][without] 3 PASS
0.355
functions_true-unreach-call1.c [OCRS][without] 3 PASS
0.362
multivar_false-unreach-call1.c [OCRS][without] 1 PASS
0.338 (0.307)
multivar_true-unreach-call1.c [OCRS][without] 1 PASS
0.349 (0.309)
nested_false-unreach-call1.c [OCRS][without] 1 PASS
0.347
nested_true-unreach-call1.c [OCRS][without] 1 PASS
0.326
overflow_true-unreach-call1.c [OCRS][without] 1 PASS
0.323
phases_false-unreach-call1.c [OCRS][without] 1 PASS
0.355
phases_false-unreach-call2.c [OCRS][without] 1 PASS
0.347
phases_true-unreach-call1.c [OCRS][without] 1 PASS
0.333
phases_true-unreach-call2.c [OCRS][without] 1 PASS
0.346
simple_false-unreach-call1.c [OCRS][without] 1 PASS
0.32
simple_false-unreach-call2.c [OCRS][without] 1 PASS
0.334
simple_false-unreach-call3.c [OCRS][without] 1 PASS
0.314
simple_false-unreach-call4.c [OCRS][without] 1 PASS
0.323
simple_true-unreach-call1.c [OCRS][without] 1 PASS
0.332
simple_true-unreach-call2.c [OCRS][without] 1 PASS
0.333 (0.298)
simple_true-unreach-call3.c [OCRS][without] 1 PASS
0.318
simple_true-unreach-call4.c [OCRS][without] 1 PASS
0.311
underapprox_false-unreach-call1.c [OCRS][without] 1 PASS
0.336
underapprox_false-unreach-call2.c [OCRS][without] 1 PASS
0.322
underapprox_true-unreach-call1.c [OCRS][without] 1 FAIL
0.336
underapprox_true-unreach-call2.c [OCRS][without] 1 PASS
0.321
Total Below Time = 11.893 (was 11.18)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-invgen
apache-escape-absolute_true-unreach-call.c [OCRS][without] 1 PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
0.864 (0.778)
apache-get-tag_true-unreach-call.c [OCRS][without] 1 PASS
PASS
PASS
FAIL
PASS
FAIL
PASS
PASS
PASS
FAIL
PASS
PASS
PASS
FAIL
PASS
FAIL
0.446 (0.398)
down_true-unreach-call.c [OCRS][without] 1 PASS
0.341
fragtest_simple_true-unreach-call.c [OCRS][without] 1 PASS
0.363
half_2_true-unreach-call.c [OCRS][without] 1 PASS
0.34
heapsort_true-unreach-call.c [OCRS][without] 1 TIMEOUT
300.182 (2.255)
id_build_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.505 (0.324)
id_trans_false-unreach-call.c [OCRS][without] 1 FAIL
FAIL
FAIL
PASS
0.339
large_const_true-unreach-call.c [OCRS][without] 1 PASS
0.405
MADWiFi-encode_ie_ok_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.373
nested6_true-unreach-call.c [OCRS][without] 1 FAIL
FAIL
PASS
0.431
nested9_true-unreach-call.c [OCRS][without] 1 PASS
0.455
nest-if3_true-unreach-call.c [OCRS][without] 1 PASS
0.423
NetBSD_loop_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.339
sendmail-close-angle_true-unreach-call.c [OCRS][without] 1 PASS
FAIL
PASS
FAIL
PASS
FAIL
PASS
FAIL
0.38
seq_true-unreach-call.c [OCRS][without] 1 PASS
0.377
SpamAssassin-loop_true-unreach-call.c [OCRS][without] TIMEOUT
300.119 (1.188)
string_concat-noarr_true-unreach-call.c [OCRS][without] 1 PASS
0.361
up_true-unreach-call.c [OCRS][without] 1 PASS
0.365 (0.307)
Total Below Time = 607.408 (was 9.981)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-lit
afnp2014_true-unreach-call.c [OCRS][without] 1 PASS
0.349
bhmr2007_true-unreach-call.c [OCRS][without] 1 PASS
0.373
cggmp2005b_true-unreach-call.c [OCRS][without] 1 PASS
0.392
cggmp2005_true-unreach-call.c [OCRS][without] 1 PASS
0.324
cggmp2005_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.335
css2003_true-unreach-call.c [OCRS][without] 1 PASS
0.485
ddlm2013_true-unreach-call.c [OCRS][without] 1 PASS
0.405
gcnr2008_false-unreach-call.c [OCRS][without] 1 TIMEOUT
300.177 (0.811)
gj2007b_true-unreach-call.c [OCRS][without] 1 PASS
FAIL
0.361
gj2007_true-unreach-call.c [OCRS][without] 1 PASS
0.349
gr2006_true-unreach-call.c [OCRS][without] 1 PASS
0.347
gsv2008_true-unreach-call.c [OCRS][without] 1 PASS
0.338 (0.307)
hhk2008_true-unreach-call.c [OCRS][without] 1 PASS
0.346
jm2006_true-unreach-call.c [OCRS][without] 1 PASS
0.372 (0.333)
jm2006_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.373
mcmillan2006_true-unreach-call.c [OCRS][without] 1 FAIL
0.384
Total Below Time = 305.71 (was 5.967)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-new
count_by_1_true-unreach-call.c [OCRS][without] 1 PASS
0.33
count_by_1_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.34
count_by_2_true-unreach-call.c [OCRS][without] 1 PASS
0.318
count_by_k_true-unreach-call.c [OCRS][without] 1 PASS
0.338
count_by_nondet_true-unreach-call.c [OCRS][without] 1 FAIL
0.346
gauss_sum_true-unreach-call.c [OCRS][without] 1 PASS
0.357 (0.32)
half_true-unreach-call.c [OCRS][without] EXCEPTION
0.359
nested_true-unreach-call.c [OCRS][without] 1 PASS
0.406
Total Below Time = 2.794 (was 2.636)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loops
array_false-unreach-call.c [OCRS][without] 1 PASS
0.434
array_true-unreach-call.c [OCRS][without] 1 FAIL
0.427
bubble_sort_false-unreach-call.c [OCRS][without] 4 PASS
PASS
150.249 (133.711)
bubble_sort_true-unreach-call.c [OCRS][without] 1 4.025 (3.585)
compact_false-unreach-call.c [OCRS][without] 1 PASS
0.347
count_up_down_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.328
count_up_down_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.335 (0.304)
eureka_01_false-unreach-call.c [OCRS][without] 1 PASS
2.315
eureka_01_true-unreach-call.c [OCRS][without] 1 FAIL
2.084 (1.855)
eureka_05_true-unreach-call.c [OCRS][without] 1 FAIL
1.134 (0.697)
for_bounded_loop1_false-unreach-call_true-termination.c [OCRS][without] 1 FAIL
FAIL
PASS
0.344 (0.312)
for_infinite_loop_1_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.328
for_infinite_loop_2_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.338
heavy_false-unreach-call.c [OCRS][without] 1 PASS
0.535
heavy_true-unreach-call.c [OCRS][without] 1 PASS
0.51
insertion_sort_false-unreach-call.c [OCRS][without] 1 PASS
2.255
insertion_sort_true-unreach-call.c [OCRS][without] 1 FAIL
0.78
invert_string_false-unreach-call.c [OCRS][without] 1 PASS
0.509
invert_string_true-unreach-call.c [OCRS][without] 1 FAIL
0.502
linear_sea.ch_true-unreach-call.c [OCRS][without] 1 FAIL
0.369
linear_search_false-unreach-call.c [OCRS][without] 1 EXCEPTION
0.416
lu.cmp_true-unreach-call.c [OCRS][without] TIMEOUT
300.264 (116.88)
ludcmp_false-unreach-call.c [OCRS][without] TIMEOUT
300.24 (117.844)
matrix_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.988 (0.772)
matrix_true-unreach-call_true-termination.c [OCRS][without] 1 FAIL
0.494
n.c11_true-unreach-call.c [OCRS][without] 3 FAIL
0.444
n.c24_false-unreach-call.c [OCRS][without] 3 PASS
22.107
n.c40_true-unreach-call.c [OCRS][without] 1 FAIL
0.358
nec11_false-unreach-call.c [OCRS][without] 1 PASS
0.357
nec20_false-unreach-call.c [OCRS][without] 1 PASS
0.351
nec40_true-unreach-call.c [OCRS][without] 1 FAIL
0.354
string_false-unreach-call.c [OCRS][without] 1 PASS
0.62
string_true-unreach-call.c [OCRS][without] 1 FAIL
0.619
sum01_bug02_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.365
sum01_bug02_sum01_bug02_base.case_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.329
sum01_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.353
sum01_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.319
sum03_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.463
sum03_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.34
sum04_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.347
sum04_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.307
sum_array_false-unreach-call.c [OCRS][without] 1 PASS
0.616
sum_array_true-unreach-call.c [OCRS][without] 1 FAIL
0.669
terminator_01_false-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.309
terminator_02_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.392
terminator_02_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.339
terminator_03_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.306
terminator_03_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.315
trex01_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.447
trex01_true-unreach-call.c [OCRS][without] 3 PASS
0.758 (0.637)
trex02_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.384
trex02_true-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.378
trex03_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.832
trex03_true-unreach-call.c [OCRS][without] 3 PASS
0.803
trex04_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.344
veris.c_NetBSD-libc__loop_true-unreach-call.c [OCRS][without] 1 PASS
0.32
veris.c_OpenSER__cases1_stripFullBoth_arr_true-unreach-call.c [OCRS][without] 3 23.827
veris.c_sendmail__tTflag_arr_one_loop_true-unreach-call.c [OCRS][without] 1 PASS
0.349
verisec_NetBSD-libc__loop_false-unreach-call.c [OCRS][without] 1 PASS
0.338
verisec_OpenSER__cases1_stripFullBoth_arr_false-unreach-call.c [OCRS][without] 3 PASS
16.5
vogal_false-unreach-call.c [OCRS][without] 1 PASS
0.827 (0.703)
vogal_true-unreach-call.c [OCRS][without] 1 FAIL
0.856 (0.74)
while_infinite_loop_1_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.297
while_infinite_loop_2_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.307
while_infinite_loop_3_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.309
while_infinite_loop_4_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.309
Total Below Time = 849.714 (was 464.633)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive
Ackermann01_true-unreach-call.c [OCRS][without] TIMEOUT
300.025 (2.363)
Ackermann02_false-unreach-call_false-termination.c [OCRS][without] TIMEOUT
300.021 (2.224)
Ackermann03_true-unreach-call.c [OCRS][without] TIMEOUT
300.02 (2.367)
Ackermann04_true-unreach-call.c [OCRS][without] TIMEOUT
300.021 (2.298)
Addition01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.564
Addition02_false-unreach-call_false-termination.c [OCRS][without] 2 PASS
0.564
Addition03_false-no-overflow.c [OCRS][without] 2 PASS
0.556
Addition03_true-unreach-call.c [OCRS][without] 2 PASS
0.56
BallRajamani-SPIN2000-Fig1_false-unreach-call.c [OCRS][without] 2 PASS
0.432
EvenOdd01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.424
EvenOdd03_false-unreach-call_false-termination.c [OCRS][without] 2 PASS
0.413
Fibonacci01_true-unreach-call.c [OCRS][without] EXCEPTION
0.912 (300.005)
Fibonacci02_true-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.904 (300.006)
Fibonacci03_true-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.913 (300.004)
Fibonacci04_false-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.891 (300.008)
Fibonacci05_false-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.902 (300.004)
gcd01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.528
gcd02_true-unreach-call.c [OCRS][without] 2 FAIL
PASS
1.304 (1.119)
McCarthy91_false-unreach-call_false-termination.c [OCRS][without] 7 PASS
1.385 (1.107)
McCarthy91_true-unreach-call.c [OCRS][without] 7 FAIL
1.394 (1.086)
MultCommutative_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.655 (0.578)
Primes_true-unreach-call.c [OCRS][without] 3 FAIL
2.016
recHanoi01_true-unreach-call_true-termination.c [OCRS][without] 9 FAIL
5.633
recHanoi02_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.376
recHanoi03_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.367
Total Below Time = 1221.78 (was 1525.323)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive-simple
afterrec_2calls_false-unreach-call.c [OCRS][without] 2 PASS
PASS
0.406
afterrec_2calls_true-unreach-call.c [OCRS][without] 2 PASS
PASS
0.358
afterrec_false-unreach-call.c [OCRS][without] 2 PASS
0.34
afterrec_true-unreach-call.c [OCRS][without] 2 PASS
0.335
fibo_10_false-unreach-call.c [OCRS][without] EXCEPTION
0.918 (300.008)
fibo_10_true-unreach-call.c [OCRS][without] EXCEPTION
0.896 (300.008)
fibo_15_false-unreach-call.c [OCRS][without] EXCEPTION
0.922 (300.005)
fibo_15_true-unreach-call.c [OCRS][without] EXCEPTION
0.903 (300.005)
fibo_20_false-unreach-call.c [OCRS][without] EXCEPTION
0.959 (300.006)
fibo_20_true-unreach-call.c [OCRS][without] EXCEPTION
0.92 (300.004)
fibo_25_false-unreach-call.c [OCRS][without] EXCEPTION
0.917 (300.007)
fibo_25_true-unreach-call.c [OCRS][without] EXCEPTION
0.929 (300.008)
fibo_2calls_10_false-unreach-call.c [OCRS][without] EXCEPTION
16.64 (128.198)
fibo_2calls_10_true-unreach-call.c [OCRS][without] EXCEPTION
16.783 (126.12)
fibo_2calls_15_false-unreach-call.c [OCRS][without] EXCEPTION
16.731 (127.924)
fibo_2calls_15_true-unreach-call.c [OCRS][without] EXCEPTION
16.758 (126.312)
fibo_2calls_20_false-unreach-call.c [OCRS][without] EXCEPTION
16.686 (127.119)
fibo_2calls_20_true-unreach-call.c [OCRS][without] EXCEPTION
16.683 (126.787)
fibo_2calls_25_false-unreach-call.c [OCRS][without] EXCEPTION
16.748 (126.445)
fibo_2calls_25_true-unreach-call.c [OCRS][without] EXCEPTION
16.693 (126.833)
fibo_2calls_2_false-unreach-call.c [OCRS][without] EXCEPTION
16.819 (126.818)
fibo_2calls_2_true-unreach-call.c [OCRS][without] EXCEPTION
16.807 (126.226)
fibo_2calls_4_false-unreach-call.c [OCRS][without] EXCEPTION
16.833 (127.638)
fibo_2calls_4_true-unreach-call.c [OCRS][without] EXCEPTION
16.716 (126.135)
fibo_2calls_5_false-unreach-call.c [OCRS][without] EXCEPTION
16.754 (126.385)
fibo_2calls_5_true-unreach-call.c [OCRS][without] EXCEPTION
16.692 (126.481)
fibo_2calls_6_false-unreach-call.c [OCRS][without] EXCEPTION
16.705 (125.902)
fibo_2calls_6_true-unreach-call.c [OCRS][without] EXCEPTION
16.917 (127.525)
fibo_2calls_8_false-unreach-call.c [OCRS][without] EXCEPTION
16.826 (125.801)
fibo_2calls_8_true-unreach-call.c [OCRS][without] EXCEPTION
16.9 (125.536)
fibo_5_false-unreach-call.c [OCRS][without] EXCEPTION
0.925 (300.007)
fibo_5_true-unreach-call.c [OCRS][without] EXCEPTION
0.931 (300.008)
fibo_7_false-unreach-call.c [OCRS][without] EXCEPTION
0.916 (300.005)
fibo_7_true-unreach-call.c [OCRS][without] EXCEPTION
0.921 (300.005)
id2_b2_o3_true-unreach-call.c [OCRS][without] 2 PASS
0.914
id2_b3_o2_false-unreach-call.c [OCRS][without] 2 PASS
0.971
id2_b3_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.936
id2_b5_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.923
id2_i5_o5_false-unreach-call.c [OCRS][without] 2 PASS
0.423
id2_i5_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.39
id_b2_o3_true-unreach-call.c [OCRS][without] 2 PASS
0.557
id_b3_o2_false-unreach-call.c [OCRS][without] 2 PASS
0.564
id_b3_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.548
id_b5_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.562
id_i10_o10_false-unreach-call.c [OCRS][without] 2 PASS
0.36
id_i10_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.356
id_i15_o15_false-unreach-call.c [OCRS][without] 2 PASS
0.361
id_i15_o15_true-unreach-call.c [OCRS][without] 2 PASS
0.361
id_i20_o20_false-unreach-call.c [OCRS][without] 2 PASS
0.367
id_i20_o20_true-unreach-call.c [OCRS][without] 2 PASS
0.366
id_i25_o25_false-unreach-call.c [OCRS][without] 2 PASS
0.36
id_i25_o25_true-unreach-call.c [OCRS][without] 2 PASS
0.367
id_i5_o5_false-unreach-call.c [OCRS][without] 2 PASS
0.362
id_i5_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.355
id_o1000_false-unreach-call.c [OCRS][without] 2 PASS
0.367
id_o100_false-unreach-call.c [OCRS][without] 2 PASS
0.353
id_o10_false-unreach-call.c [OCRS][without] 2 PASS
0.362
id_o200_false-unreach-call.c [OCRS][without] 2 PASS
0.367
id_o20_false-unreach-call.c [OCRS][without] 2 PASS
0.37
id_o3_false-unreach-call.c [OCRS][without] 2 PASS
0.364
sum_10x0_false-unreach-call.c [OCRS][without] 2 PASS
0.376
sum_10x0_true-unreach-call.c [OCRS][without] 2 PASS
0.366
sum_15x0_false-unreach-call.c [OCRS][without] 2 PASS
0.388
sum_15x0_true-unreach-call.c [OCRS][without] 2 PASS
0.366
sum_20x0_false-unreach-call.c [OCRS][without] 2 PASS
0.383
sum_20x0_true-unreach-call.c [OCRS][without] 2 PASS
0.368
sum_25x0_false-unreach-call.c [OCRS][without] 2 PASS
0.386
sum_25x0_true-unreach-call.c [OCRS][without] 2 PASS
0.363
sum_2x3_false-unreach-call.c [OCRS][without] 2 PASS
0.372
sum_2x3_true-unreach-call.c [OCRS][without] 2 PASS
0.371
sum_non_eq_false-unreach-call.c [OCRS][without] 2 PASS
0.421
sum_non_eq_true-unreach-call.c [OCRS][without] 2 PASS
0.409
sum_non_false-unreach-call.c [OCRS][without] 2 PASS
0.389
sum_non_true-unreach-call.c [OCRS][without] 2 PASS
0.369
Total Below Time = 332.1 (was 5899.407)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-lit
rec-afnp2014_true-unreach-call.c [OCRS][without] 2 PASS
0.353
rec-bhmr2007_true-unreach-call.c [OCRS][without] 2 PASS
0.399
rec-cggmp2005b_true-unreach-call.c [OCRS][without] 3 PASS
0.725
rec-cggmp2005_true-unreach-call.c [OCRS][without] 2 PASS
0.323
rec-cggmp2005_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.338
rec-css2003_true-unreach-call.c [OCRS][without] 2 PASS
0.604
rec-ddlm2013_true-unreach-call.c [OCRS][without] EXCEPTION
0.34 (0.429)
rec-gcnr2008_false-unreach-call.c [OCRS][without] 2 PASS
0.841
rec-gj2007b_true-unreach-call.c [OCRS][without] 2 FAIL
FAIL
0.379
rec-gj2007_true-unreach-call.c [OCRS][without] 2 FAIL
0.361
rec-gr2006_true-unreach-call.c [OCRS][without] 2 FAIL
0.372
rec-gsv2008_true-unreach-call.c [OCRS][without] 2 PASS
0.348
rec-hhk2008_true-unreach-call.c [OCRS][without] 2 PASS
0.336
rec-jm2006_true-unreach-call.c [OCRS][without] 2 PASS
0.359
rec-jm2006_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.379
rec-mcmillan2006_true-unreach-call.c [OCRS][without] 2 FAIL
0.407
Total Below Time = 6.864 (was 6.891)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-new
rec-count_by_1_true-unreach-call.c [OCRS][without] 2 PASS
0.325
rec-count_by_1_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.352
rec-count_by_2_true-unreach-call.c [OCRS][without] 2 PASS
0.319
rec-count_by_k_true-unreach-call.c [OCRS][without] 2 PASS
0.35
rec-count_by_nondet_true-unreach-call.c [OCRS][without] 2 FAIL
0.38
rec-gauss_sum_true-unreach-call.c [OCRS][without] 2 PASS
0.354
rec-half_true-unreach-call.c [OCRS][without] EXCEPTION
0.329 (0.373)
rec-nested_true-unreach-call.c [OCRS][without] 3 PASS
0.577
Total Below Time = 2.986 (was 2.996)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/recurrences
cubic_polynomial.c [OCRS][without] 2 PASS
0.508
edit_distance_bottom_up.c [OCRS][without] 3 FAIL
299.106
edit_distance_top_down.c [OCRS][without] 3 FAIL
49.734
log_log_n_solution.c [OCRS][without] 3 FAIL
0.416 (0.62)
log_n_solution.c [OCRS][without] 2 FAIL
0.424
multivariate_1.c [OCRS][without] TIMEOUT
300.005
multivariate_higher_order.c [OCRS][without] 7 FAIL
FAIL
FAIL
24.565
n_cubed_solution.c [OCRS][without] EXCEPTION
0.304
n_log_n_solution.c [OCRS][without] TIMEOUT
300.025 (1.829)
n_squared_two_base_case_even.c [OCRS][without] 2 PASS
0.376
n_squared_two_base_case_odd.c [OCRS][without] 2 PASS
0.371
pascals_dynamic.c [OCRS][without] 3 FAIL
19.198
pascals_iterative.c [OCRS][without] 1 FAIL
5.057 (5.937)
pascals_recursive.c [OCRS][without] TIMEOUT
300.005
squared_solution.c [OCRS][without] TIMEOUT
300.129 (11.996)
two_n_even.c [OCRS][without] 2 PASS
0.349
two_n_odd.c [OCRS][without] 2 PASS
0.36
two_to_n_over_two_even.c [OCRS][without] TIMEOUT
300.028 (44.008)
two_to_n_over_two_odd.c [OCRS][without] TIMEOUT
300.03 (43.882)
two_to_n_squared.c [OCRS][without] 8 TIMEOUT
300.004 (128.579)
two_to_two_to_n.c [OCRS][without] 7 FAIL
1.605
Total Below Time = 2502.599 (was 1231.046)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/exponential
adding_and_mult.c [OCRS][without] 1 PASS
0.31
binary_search_array_tree.c [OCRS][without] 1 FAIL
FAIL
1.288 (0.628)
exp_add_loop_rec.c [OCRS][without] 1 FAIL
0.329
exp_add_loop_variable.c [OCRS][without] 1 PASS
0.329
exp_with_linear_inner_loop.c [OCRS][without] 1 FAIL
0.396
halving_log1.c [OCRS][without] 1 PASS
0.427 (0.374)
linear_two_to_n.c [OCRS][without] 8 FAIL
1.495 (1.301)
loop_five_to_n.c [OCRS][without] 1 FAIL
0.325
non_loop_five_to_n.c [OCRS][without] 8 FAIL
9.757 (8.433)
power_log.c [OCRS][without] 1 PASS
0.404 (0.362)
power_log_modified.c [OCRS][without] 1 PASS
0.458 (0.385)
simple_exponential.c [OCRS][without] 1 PASS
0.328
simple_exponential_for.c [OCRS][without] 1 PASS
0.335
two_to_n_minus_n.c [OCRS][without] 8 FAIL
1.741 (1.577)
two_to_n_minus_n_loop.c [OCRS][without] 8 FAIL
2.725 (2.475)
Total Below Time = 20.647 (was 17.868)

>25% better
25%-10% better
No significant change
10%-25% worse
>25% worse