[Version Information]
Phase2 (IST-Java-ICRA) WALi-OpenNWA version: eeaa6a4c577535d1bcb47a13ddf1230e2f98e207 (2017-05-19 15:05:02 -0500) "Two small niceties in NewtonCompare.cpp"
Phase2 (IST-Java-ICRA) duet version: 393b2fa15ae67d4cf44b9a72bd4e0c54307ef649 (2017-05-16 13:07:27 -0400) "Updated the costs for thread.sleep from 10 to 1000"

Phase3 WALi-OpenNWA version: eeaa6a4c577535d1bcb47a13ddf1230e2f98e207 (2017-05-19 15:05:02 -0500) "Two small niceties in NewtonCompare.cpp"
Phase3 duet version: 0fa8064dfa94888565bc782359017482a22e6f46 (2017-05-16 08:41:47 -0400) "Fixed build after merge"
# Installed packages for 4.02.1+PIC:
apron              20160125  APRON numerical abstract domain library
base-bigarray          base  Bigarray library distributed with the OCaml compile
base-bytes             base  Bytes library distributed with the OCaml compiler
base-ocamlbuild        base  OCamlbuild binary and libraries distributed with th
base-threads           base  Threads library distributed with the OCaml compiler
base-unix              base  Unix library distributed with the OCaml compiler
batteries             2.5.3  a community-maintained standard library extension
camlidl                1.05  Stub code generator for OCaml
camlp4               4.02+7  Camlp4 is a system for writing extensible parsers f
cil                20150825  A front-end for the C programming language that fac
conf-gmp                  1  Virtual package relying on a GMP lib system install
conf-m4                   1  Virtual package relying on m4
conf-mathsat              1  Virtual package relying on a MathSAT system install
conf-mpfr                 1  Virtual package relying on library MPFR installatio
conf-perl                 1  Virtual package relying on perl
conf-python-2-7         1.0  Virtual package relying on Python-2.7 installation.
conf-which                1  Virtual package relying on which
cppo                  1.4.1  Equivalent of the C preprocessor for OCaml programs
deriving           20140904  Extension to OCaml for deriving functions from type
mathsat            20161206  MathSAT 5 SMT solver
menhir             20170101  LR(1) parser generator
mlgmpidl              1.2.4  OCaml interface to the GMP library
oasis                 0.4.8  Tooling for building OCaml libraries and applicatio
ocamlbuild                0  Build system distributed with the OCaml compiler si
ocamlfind             1.7.1  A library manager for OCaml
ocamlgraph            1.8.7  A generic graph library for OCaml
ocamlify              0.0.1  Include files in OCaml code
ocamlmod              0.0.8  Generate OCaml modules from source files
OCRS               20170323  Recurrence solver based on operational calculus
optcomp                 1.6  Optional compilation with cpp-like directives
ounit                 2.0.0  Unit testing framework loosely based on HUnit. It i
ppx_deriving            4.1  Type-driven code generation for OCaml >=4.02
ppx_tools        5.0+4.02.0  Tools for authors of ppx rewriters and other syntac
result                  1.2  Compatibility Result module
Z3                 20161217  Z3 SMT solver

Test Name Output No. of Rounds Result Time (Prev.)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/c4b
gcd.c [OCRS][without] 1 FAIL
0.356
kmp.c [OCRS][without] 1 PASS
1.321 (1.176)
qsort.c [OCRS][without] 5 PASS
3.419 (2.043)
speed_pldi09_fig1.c [OCRS][without] 1 PASS
0.375
speed_pldi09_fig4_2.c [OCRS][without] 1 FAIL
0.398
speed_pldi09_fig4_4.c [OCRS][without] 1 PASS
0.445
speed_pldi09_fig4_5.c [OCRS][without] 1 PASS
0.374
speed_pldi10_ex1.c [OCRS][without] 1 PASS
3.897 (0.831)
speed_pldi10_ex3.c [OCRS][without] 1 PASS
0.461
speed_pldi10_ex4.c [OCRS][without] EXCEPTION
0.404
speed_popl10_fig2_1.c [OCRS][without] 1 PASS
0.387
speed_popl10_fig2_2.c [OCRS][without] 1 FAIL
0.369
speed_popl10_nested_multiple.c [OCRS][without] 1 PASS
0.429
speed_popl10_nested_single.c [OCRS][without] 1 PASS
0.398
speed_popl10_sequential_single.c [OCRS][without] 1 PASS
0.362
speed_popl10_simple_multiple.c [OCRS][without] 1 PASS
0.396
speed_popl10_simple_single_2.c [OCRS][without] 1 PASS
0.415
speed_popl10_simple_single.c [OCRS][without] 1 PASS
0.343
t07.c [OCRS][without] 1 PASS
0.376
t08.c [OCRS][without] 1 PASS
0.351
t09.c [OCRS][without] 1 PASS
0.357
t10.c [OCRS][without] 1 PASS
0.363
t11.c [OCRS][without] 1 PASS
0.388
t13.c [OCRS][without] 1 FAIL
0.393
t15.c [OCRS][without] 1 PASS
0.367
t16.c [OCRS][without] 1 PASS
0.36
t19.c [OCRS][without] 1 PASS
0.348
t20.c [OCRS][without] 1 PASS
0.342
t27.c [OCRS][without] 1 PASS
0.416
t28.c [OCRS][without] 1 PASS
0.382
t30.c [OCRS][without] 1 FAIL
0.353
t37.c [OCRS][without] 2 PASS
0.468
t39.c [OCRS][without] 2 PASS
0.501
t46.c [OCRS][without] 1 PASS
0.354
t47.c [OCRS][without] 1 PASS
0.37
Total Below Time = 21.038 (was 16.274)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/misc-recursive
mult-rec.c [OCRS][without] 2 PASS
PASS
0.392
qsort_full.c [OCRS][without] 5 TIMEOUT
300.009 (41.856)
rec1-param_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.35
rec1-param_unsafe.c [OCRS][without] 2 PASS
0.346
rec1_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.339
rec1_unsafe.c [OCRS][without] 2 PASS
0.334
rec2-param_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.352
rec2-param_unsafe.c [OCRS][without] 2 PASS
0.356
rec2_safe.c [OCRS][without] 2 PASS
PASS
PASS
0.337
rec2_unsafe.c [OCRS][without] 2 PASS
0.353
rec-test.c [OCRS][without] 2 PASS
0.361 (0.327)
sas03_bothbranches.c [OCRS][without] 7 PASS
1.292
sas03.c [OCRS][without] 2 PASS
0.793
simulated_lese_recursive.c [OCRS][without] 2 PASS
0.382
Total Below Time = 305.996 (was 47.738)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/duet
count_up_down_safe.c [OCRS][without] 1 PASS
0.326
count_up_down_unsafe.c [OCRS][without] 1 PASS
0.317
divide.c [OCRS][without] 1 PASS
0.318
factor_unsafe.c [OCRS][without] 1 PASS
0.321
for_infinite_loop_1_safe.c [OCRS][without] 1 PASS
0.33
for_infinite_loop_2_safe.c [OCRS][without] 1 PASS
0.326
interproc.c [OCRS][without] 1 PASS
0.326
mult.c [OCRS][without] 1 PASS
PASS
0.325
pointer_arith.c [OCRS][without] 1 PASS
PASS
PASS
PASS
0.315
quotient.c [OCRS][without] 3 PASS
0.445
subtract.c [OCRS][without] 1 PASS
0.316
sum01_bug02_sum01_bug02_base.case_unsafe.c [OCRS][without] 1 PASS
0.331
sum01_bug02_unsafe.c [OCRS][without] 1 PASS
0.417
sum01_real_safe.c [OCRS][without] 1 PASS
0.331
sum01_safe.c [OCRS][without] 1 PASS
0.324
sum01_unsafe.c [OCRS][without] 1 PASS
0.371
sum02_safe.c [OCRS][without] 1 PASS
0.327
sum03_safe.c [OCRS][without] 1 PASS
0.337
sum03_unsafe.c [OCRS][without] 1 PASS
0.411
sum04_safe.c [OCRS][without] 1 PASS
0.322
sum04_unsafe.c [OCRS][without] 1 PASS
0.357
terminator_02_safe.c [OCRS][without] 1 PASS
0.324
terminator_02_unsafe.c [OCRS][without] 1 PASS
0.363
terminator_03_safe.c [OCRS][without] 1 PASS
0.326
terminator_03_unsafe.c [OCRS][without] 1 PASS
0.314 (0.35)
token_ring01_safe.c [OCRS][without] TIMEOUT
300.006
token_ring01_unsafe.c [OCRS][without] TIMEOUT
300.008
toy_safe.c [OCRS][without] EXCEPTION
158.945
trex01_safe.c [OCRS][without] 1 PASS
0.738
trex01_unsafe.c [OCRS][without] 1 PASS
0.367
trex02_safe2.c [OCRS][without] 3 PASS
0.384
trex02_safe.c [OCRS][without] 3 PASS
0.393
trex02_unsafe.c [OCRS][without] 3 PASS
0.389
trex03_safe.c [OCRS][without] 1 PASS
0.477
trex03_unsafe.c [OCRS][without] 1 PASS
0.465 (0.416)
trex04_safe.c [OCRS][without] 1 PASS
0.352
while_infinite_loop_1_safe.c [OCRS][without] 1 PASS
0.322
while_infinite_loop_2_safe.c [OCRS][without] 1 PASS
0.324
while_infinite_loop_3_safe.c [OCRS][without] 1 PASS
0.312
Total Below Time = 772.002 (was 780.319)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests
above_litmus.c [OCRS][without] 3 PASS
0.441
blogger_simplified1.c [OCRS][without] 3 PASS
0.975
divided_difference2.c [OCRS][without] TIMEOUT
300.004
mult-proc.c [OCRS][without] 3 PASS
PASS
0.349
mult-proc-params.c [OCRS][without] 3 PASS
PASS
0.399
popall.c [OCRS][without] 1 PASS
PASS
PASS
PASS
PASS
0.412
simulated_scc.c [OCRS][without] 1 PASS
PASS
0.515
Total Below Time = 303.095 (was 303.031)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/polynomial/assert
degree1_monomial.c [OCRS][without] 1 PASS
0.349
degree2_binomial.c [OCRS][without] 1 PASS
0.449
degree2_monomial.c [OCRS][without] 1 PASS
0.372
degree3_binomial.c [OCRS][without] 1 PASS
0.883
degree3_monomial.c [OCRS][without] 1 PASS
0.417
degree4_binomial.c [OCRS][without] 1 PASS
1.147
degree4_monomial.c [OCRS][without] 1 PASS
0.509
degree5_binomial.c [OCRS][without] 1 PASS
1.709 (1.908)
degree5_monomial.c [OCRS][without] 1 PASS
0.582
Total Below Time = 6.417 (was 6.441)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/snlee/snlee_tests
cubic_with_square.c [OCRS][without] 1 PASS
0.346
cubic_with_square_interproc.c [OCRS][without] 2 PASS
0.372
cubic_with_square_nonlinear.c [OCRS][without] 1 PASS
0.356
cubic_with_square_nonlinear_interproc.c [OCRS][without] 2 PASS
0.367
cubic_with_square_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.358
cubic_with_square_unsafe.c [OCRS][without] 1 PASS
0.335
multi-input.c [OCRS][without] 1 PASS
0.41
multi-input_unsafe.c [OCRS][without] 1 PASS
0.431 (0.485)
nondet_loop_bound.c [OCRS][without] 1 PASS
0.35
nondet_loop_bound_quartic.c [OCRS][without] 1 PASS
0.353
nondet_loop_bound_quartic_unsafe.c [OCRS][without] 1 PASS
0.362
nondet_loop_bound_unsafe.c [OCRS][without] 1 PASS
0.371
nonlinear_stratified.c [OCRS][without] 1 FAIL
0.347
nonlinear_stratified_unsafe.c [OCRS][without] 1 PASS
0.358
quartic_with_cube.c [OCRS][without] 1 PASS
0.351
quartic_with_cube_nonlinear.c [OCRS][without] 1 PASS
0.376
quartic_with_cube_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.366
quartic_with_cube_unsafe.c [OCRS][without] 1 PASS
0.355
quintic_with_quartic.c [OCRS][without] 1 PASS
0.354
quintic_with_quartic_nonlinear.c [OCRS][without] 1 PASS
0.394
quintic_with_quartic_nonlinear_unsafe.c [OCRS][without] 1 PASS
0.363 (0.486)
quintic_with_quartic_unsafe.c [OCRS][without] 1 PASS
0.356
Total Below Time = 8.031 (was 8.229)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/FiniteDifferencing
degree2.c [OCRS][without] 1 PASS
0.498
degree2_FD_AllAux_AllAssm.c [OCRS][without] 1 PASS
3.595 (3.11)
degree2_FD_AllAux_FewAssm.c [OCRS][without] 1 PASS
5.442 (3.063)
degree2_FD_FewAux_FewAssm.c [OCRS][without] 1 PASS
0.701
degree2_FD_FewAux_FewAssm_NonLinAsrt.c [OCRS][without] 1 PASS
0.693
degree3.c [OCRS][without] 1 PASS
0.545
degree3_FD.c [OCRS][without] 1 PASS
0.688
degree4.c [OCRS][without] 1 PASS
0.382
Total Below Time = 12.544 (was 9.732)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LESE
loop.c [OCRS][without] 1 PASS
0.396
loop_unsafe.c [OCRS][without] 1 PASS
0.41
simulated_lese_parser.c [OCRS][without] 1 PASS
0.327
simulated_lese_sentinel.c [OCRS][without] 1 PASS
0.339
Total Below Time = 1.472 (was 1.471)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LowerBound
lower_bound.c [OCRS][without] 1 PASS
PASS
PASS
0.333
Total Below Time = 0.333 (was 0.336)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LZ
lz77.c [OCRS][without] TIMEOUT
300.014
Total Below Time = 300.014 (was 300.006)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-acceleration
array_false-unreach-call1.c [OCRS][without] 1 PASS
0.34
array_false-unreach-call2.c [OCRS][without] 1 PASS
0.358
array_false-unreach-call3.c [OCRS][without] 1 PASS
0.332
array_true-unreach-call1.c [OCRS][without] 1 FAIL
0.346
array_true-unreach-call2.c [OCRS][without] 1 FAIL
0.369
array_true-unreach-call3.c [OCRS][without] 1 PASS
0.337
array_true-unreach-call4.c [OCRS][without] 1 FAIL
0.333
const_false-unreach-call1.c [OCRS][without] 1 PASS
0.313
const_true-unreach-call1.c [OCRS][without] 1 PASS
0.316
diamond_false-unreach-call1.c [OCRS][without] 1 PASS
0.327
diamond_true-unreach-call1.c [OCRS][without] 1 PASS
0.328
diamond_true-unreach-call2.c [OCRS][without] 1 PASS
0.364
functions_false-unreach-call1.c [OCRS][without] 3 PASS
0.366
functions_true-unreach-call1.c [OCRS][without] 3 PASS
0.355
multivar_false-unreach-call1.c [OCRS][without] 1 PASS
0.309
multivar_true-unreach-call1.c [OCRS][without] 1 PASS
0.313
nested_false-unreach-call1.c [OCRS][without] 1 PASS
0.332
nested_true-unreach-call1.c [OCRS][without] 1 PASS
0.337
overflow_true-unreach-call1.c [OCRS][without] 1 PASS
0.316
phases_false-unreach-call1.c [OCRS][without] 1 PASS
0.332
phases_false-unreach-call2.c [OCRS][without] 1 PASS
0.346
phases_true-unreach-call1.c [OCRS][without] 1 PASS
0.337
phases_true-unreach-call2.c [OCRS][without] 1 PASS
0.337
simple_false-unreach-call1.c [OCRS][without] 1 PASS
0.324
simple_false-unreach-call2.c [OCRS][without] 1 PASS
0.33
simple_false-unreach-call3.c [OCRS][without] 1 PASS
0.318
simple_false-unreach-call4.c [OCRS][without] 1 PASS
0.313
simple_true-unreach-call1.c [OCRS][without] 1 PASS
0.314
simple_true-unreach-call2.c [OCRS][without] 1 PASS
0.311
simple_true-unreach-call3.c [OCRS][without] 1 PASS
0.329
simple_true-unreach-call4.c [OCRS][without] 1 PASS
0.338
underapprox_false-unreach-call1.c [OCRS][without] 1 PASS
0.322
underapprox_false-unreach-call2.c [OCRS][without] 1 PASS
0.32
underapprox_true-unreach-call1.c [OCRS][without] 1 FAIL
0.353 (0.314)
underapprox_true-unreach-call2.c [OCRS][without] 1 PASS
0.323
Total Below Time = 11.638 (was 11.546)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-invgen
apache-escape-absolute_true-unreach-call.c [OCRS][without] 1 PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
PASS
0.842
apache-get-tag_true-unreach-call.c [OCRS][without] 1 PASS
PASS
PASS
FAIL
PASS
FAIL
PASS
PASS
PASS
FAIL
PASS
PASS
PASS
FAIL
PASS
FAIL
0.472 (0.412)
down_true-unreach-call.c [OCRS][without] 1 PASS
0.34 (0.302)
fragtest_simple_true-unreach-call.c [OCRS][without] 1 PASS
0.379
half_2_true-unreach-call.c [OCRS][without] 1 PASS
0.343
heapsort_true-unreach-call.c [OCRS][without] 1 TIMEOUT
300.15 (2.326)
id_build_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.334
id_trans_false-unreach-call.c [OCRS][without] 1 FAIL
FAIL
FAIL
PASS
0.345
large_const_true-unreach-call.c [OCRS][without] 1 PASS
0.418
MADWiFi-encode_ie_ok_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.364
nested6_true-unreach-call.c [OCRS][without] 1 FAIL
FAIL
PASS
0.41
nested9_true-unreach-call.c [OCRS][without] 1 PASS
0.46
nest-if3_true-unreach-call.c [OCRS][without] 1 PASS
0.405
NetBSD_loop_true-unreach-call.c [OCRS][without] 1 PASS
PASS
0.335
sendmail-close-angle_true-unreach-call.c [OCRS][without] 1 PASS
FAIL
PASS
FAIL
PASS
FAIL
PASS
FAIL
0.377
seq_true-unreach-call.c [OCRS][without] 1 PASS
0.374
SpamAssassin-loop_true-unreach-call.c [OCRS][without] TIMEOUT
300.107 (1.22)
string_concat-noarr_true-unreach-call.c [OCRS][without] 1 PASS
0.344
up_true-unreach-call.c [OCRS][without] 1 PASS
0.322
Total Below Time = 607.121 (was 10.258)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-lit
afnp2014_true-unreach-call.c [OCRS][without] 1 PASS
0.33
bhmr2007_true-unreach-call.c [OCRS][without] 1 PASS
0.358
cggmp2005b_true-unreach-call.c [OCRS][without] 1 PASS
0.398
cggmp2005_true-unreach-call.c [OCRS][without] 1 PASS
0.33
cggmp2005_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.333
css2003_true-unreach-call.c [OCRS][without] 1 PASS
0.481
ddlm2013_true-unreach-call.c [OCRS][without] 1 PASS
0.372
gcnr2008_false-unreach-call.c [OCRS][without] 1 TIMEOUT
300.167 (0.845)
gj2007b_true-unreach-call.c [OCRS][without] 1 PASS
FAIL
0.356
gj2007_true-unreach-call.c [OCRS][without] 1 PASS
0.341
gr2006_true-unreach-call.c [OCRS][without] 1 PASS
0.343
gsv2008_true-unreach-call.c [OCRS][without] 1 PASS
0.314
hhk2008_true-unreach-call.c [OCRS][without] 1 PASS
0.332
jm2006_true-unreach-call.c [OCRS][without] 1 PASS
0.353
jm2006_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.364
mcmillan2006_true-unreach-call.c [OCRS][without] 1 FAIL
0.367
Total Below Time = 305.539 (was 6.209)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-new
count_by_1_true-unreach-call.c [OCRS][without] 1 PASS
0.325
count_by_1_variant_true-unreach-call.c [OCRS][without] 1 PASS
0.321
count_by_2_true-unreach-call.c [OCRS][without] 1 PASS
0.317
count_by_k_true-unreach-call.c [OCRS][without] 1 PASS
0.327
count_by_nondet_true-unreach-call.c [OCRS][without] 1 FAIL
0.343
gauss_sum_true-unreach-call.c [OCRS][without] 1 PASS
0.328
half_true-unreach-call.c [OCRS][without] EXCEPTION
0.33 (0.373)
nested_true-unreach-call.c [OCRS][without] 1 PASS
0.386
Total Below Time = 2.677 (was 2.745)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loops
array_false-unreach-call.c [OCRS][without] 1 PASS
0.419
array_true-unreach-call.c [OCRS][without] 1 FAIL
0.427
bubble_sort_false-unreach-call.c [OCRS][without] 4 PASS
PASS
139.354
bubble_sort_true-unreach-call.c [OCRS][without] 1 3.724
compact_false-unreach-call.c [OCRS][without] 1 PASS
0.36
count_up_down_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.318
count_up_down_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.33
eureka_01_false-unreach-call.c [OCRS][without] 1 PASS
2.189
eureka_01_true-unreach-call.c [OCRS][without] 1 FAIL
1.935
eureka_05_true-unreach-call.c [OCRS][without] 1 FAIL
1.101 (0.741)
for_bounded_loop1_false-unreach-call_true-termination.c [OCRS][without] 1 FAIL
FAIL
PASS
0.336
for_infinite_loop_1_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.311
for_infinite_loop_2_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.319
heavy_false-unreach-call.c [OCRS][without] 1 PASS
0.527
heavy_true-unreach-call.c [OCRS][without] 1 PASS
0.505
insertion_sort_false-unreach-call.c [OCRS][without] 1 PASS
2.108
insertion_sort_true-unreach-call.c [OCRS][without] 1 FAIL
0.74
invert_string_false-unreach-call.c [OCRS][without] 1 PASS
0.501
invert_string_true-unreach-call.c [OCRS][without] 1 FAIL
0.483
linear_sea.ch_true-unreach-call.c [OCRS][without] 1 FAIL
0.38
linear_search_false-unreach-call.c [OCRS][without] 1 EXCEPTION
0.392
lu.cmp_true-unreach-call.c [OCRS][without] TIMEOUT
300.252 (120.757)
ludcmp_false-unreach-call.c [OCRS][without] TIMEOUT
300.255 (123.284)
matrix_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.989 (0.799)
matrix_true-unreach-call_true-termination.c [OCRS][without] 1 FAIL
0.519
n.c11_true-unreach-call.c [OCRS][without] 3 FAIL
0.476
n.c24_false-unreach-call.c [OCRS][without] 3 PASS
23.429
n.c40_true-unreach-call.c [OCRS][without] 1 FAIL
0.372
nec11_false-unreach-call.c [OCRS][without] 1 PASS
0.375
nec20_false-unreach-call.c [OCRS][without] 1 PASS
0.348
nec40_true-unreach-call.c [OCRS][without] 1 FAIL
0.37
string_false-unreach-call.c [OCRS][without] 1 PASS
0.643
string_true-unreach-call.c [OCRS][without] 1 FAIL
0.656
sum01_bug02_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.373
sum01_bug02_sum01_bug02_base.case_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.349
sum01_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.359
sum01_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.331
sum03_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.452
sum03_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.351
sum04_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.364
sum04_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.313
sum_array_false-unreach-call.c [OCRS][without] 1 PASS
0.636
sum_array_true-unreach-call.c [OCRS][without] 1 FAIL
0.704
terminator_01_false-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.32
terminator_02_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.404
terminator_02_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.341
terminator_03_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.326
terminator_03_true-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.32
trex01_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.425
trex01_true-unreach-call.c [OCRS][without] 3 PASS
0.764 (0.667)
trex02_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.389
trex02_true-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.382
trex03_false-unreach-call_true-termination.c [OCRS][without] 3 PASS
0.827
trex03_true-unreach-call.c [OCRS][without] 3 PASS
0.868
trex04_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.372
veris.c_NetBSD-libc__loop_true-unreach-call.c [OCRS][without] 1 PASS
0.328
veris.c_OpenSER__cases1_stripFullBoth_arr_true-unreach-call.c [OCRS][without] 3 24.257
veris.c_sendmail__tTflag_arr_one_loop_true-unreach-call.c [OCRS][without] 1 PASS
0.359
verisec_NetBSD-libc__loop_false-unreach-call.c [OCRS][without] 1 PASS
0.348
verisec_OpenSER__cases1_stripFullBoth_arr_false-unreach-call.c [OCRS][without] 3 PASS
17.166
vogal_false-unreach-call.c [OCRS][without] 1 PASS
0.81
vogal_true-unreach-call.c [OCRS][without] 1 FAIL
0.827 (0.737)
while_infinite_loop_1_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.305
while_infinite_loop_2_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.306
while_infinite_loop_3_true-unreach-call_false-termination.c [OCRS][without] 1 PASS
0.317
while_infinite_loop_4_false-unreach-call_true-termination.c [OCRS][without] 1 PASS
0.321
Total Below Time = 840.757 (was 481.393)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive
Ackermann01_true-unreach-call.c [OCRS][without] TIMEOUT
300.021 (2.404)
Ackermann02_false-unreach-call_false-termination.c [OCRS][without] TIMEOUT
300.019 (2.274)
Ackermann03_true-unreach-call.c [OCRS][without] TIMEOUT
300.02 (2.41)
Ackermann04_true-unreach-call.c [OCRS][without] TIMEOUT
300.019 (2.438)
Addition01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.552
Addition02_false-unreach-call_false-termination.c [OCRS][without] 2 PASS
0.556
Addition03_false-no-overflow.c [OCRS][without] 2 PASS
0.596
Addition03_true-unreach-call.c [OCRS][without] 2 PASS
0.569
BallRajamani-SPIN2000-Fig1_false-unreach-call.c [OCRS][without] 2 PASS
0.459
EvenOdd01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.427
EvenOdd03_false-unreach-call_false-termination.c [OCRS][without] 2 PASS
0.414
Fibonacci01_true-unreach-call.c [OCRS][without] EXCEPTION
0.937 (300.01)
Fibonacci02_true-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.934 (300.01)
Fibonacci03_true-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.94 (300.004)
Fibonacci04_false-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.949 (300.011)
Fibonacci05_false-unreach-call_true-termination.c [OCRS][without] EXCEPTION
0.903 (300.005)
gcd01_true-unreach-call_true-termination.c [OCRS][without] 2 PASS
0.545
gcd02_true-unreach-call.c [OCRS][without] 2 FAIL
PASS
1.315 (1.171)
McCarthy91_false-unreach-call_false-termination.c [OCRS][without] 7 PASS
1.456 (1.113)
McCarthy91_true-unreach-call.c [OCRS][without] 7 FAIL
1.399 (1.11)
MultCommutative_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.657 (0.59)
Primes_true-unreach-call.c [OCRS][without] 3 FAIL
1.993
recHanoi01_true-unreach-call_true-termination.c [OCRS][without] 9 FAIL
5.614
recHanoi02_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.36
recHanoi03_true-unreach-call_true-termination.c [OCRS][without] 2 FAIL
0.364
Total Below Time = 1222.018 (was 1526.298)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive-simple
afterrec_2calls_false-unreach-call.c [OCRS][without] 2 PASS
PASS
0.41
afterrec_2calls_true-unreach-call.c [OCRS][without] 2 PASS
PASS
0.38
afterrec_false-unreach-call.c [OCRS][without] 2 PASS
0.35
afterrec_true-unreach-call.c [OCRS][without] 2 PASS
0.342
fibo_10_false-unreach-call.c [OCRS][without] EXCEPTION
0.941 (300.008)
fibo_10_true-unreach-call.c [OCRS][without] EXCEPTION
0.935 (300.01)
fibo_15_false-unreach-call.c [OCRS][without] EXCEPTION
0.93 (300.005)
fibo_15_true-unreach-call.c [OCRS][without] EXCEPTION
0.934 (300.008)
fibo_20_false-unreach-call.c [OCRS][without] EXCEPTION
0.936 (300.01)
fibo_20_true-unreach-call.c [OCRS][without] EXCEPTION
0.902 (300.004)
fibo_25_false-unreach-call.c [OCRS][without] EXCEPTION
0.933 (300.011)
fibo_25_true-unreach-call.c [OCRS][without] EXCEPTION
0.96 (300.011)
fibo_2calls_10_false-unreach-call.c [OCRS][without] EXCEPTION
16.926 (129.053)
fibo_2calls_10_true-unreach-call.c [OCRS][without] EXCEPTION
17.146 (130.9)
fibo_2calls_15_false-unreach-call.c [OCRS][without] EXCEPTION
17.176 (130.109)
fibo_2calls_15_true-unreach-call.c [OCRS][without] EXCEPTION
17.038 (128.194)
fibo_2calls_20_false-unreach-call.c [OCRS][without] EXCEPTION
17.102 (130.376)
fibo_2calls_20_true-unreach-call.c [OCRS][without] EXCEPTION
17.032 (130.178)
fibo_2calls_25_false-unreach-call.c [OCRS][without] EXCEPTION
16.927 (129.392)
fibo_2calls_25_true-unreach-call.c [OCRS][without] EXCEPTION
17.104 (130.906)
fibo_2calls_2_false-unreach-call.c [OCRS][without] EXCEPTION
17.164 (128.432)
fibo_2calls_2_true-unreach-call.c [OCRS][without] EXCEPTION
17.185 (131.077)
fibo_2calls_4_false-unreach-call.c [OCRS][without] EXCEPTION
17.076 (129.616)
fibo_2calls_4_true-unreach-call.c [OCRS][without] EXCEPTION
17.319 (129.952)
fibo_2calls_5_false-unreach-call.c [OCRS][without] EXCEPTION
17.233 (130.335)
fibo_2calls_5_true-unreach-call.c [OCRS][without] EXCEPTION
17.014 (128.559)
fibo_2calls_6_false-unreach-call.c [OCRS][without] EXCEPTION
17.368 (127.595)
fibo_2calls_6_true-unreach-call.c [OCRS][without] EXCEPTION
17.045 (129.456)
fibo_2calls_8_false-unreach-call.c [OCRS][without] EXCEPTION
17.366 (130.576)
fibo_2calls_8_true-unreach-call.c [OCRS][without] EXCEPTION
17.127 (130.195)
fibo_5_false-unreach-call.c [OCRS][without] EXCEPTION
0.896 (300.01)
fibo_5_true-unreach-call.c [OCRS][without] EXCEPTION
0.91 (300.005)
fibo_7_false-unreach-call.c [OCRS][without] EXCEPTION
0.926 (300.007)
fibo_7_true-unreach-call.c [OCRS][without] EXCEPTION
0.936 (300.009)
id2_b2_o3_true-unreach-call.c [OCRS][without] 2 PASS
0.935
id2_b3_o2_false-unreach-call.c [OCRS][without] 2 PASS
0.96
id2_b3_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.954
id2_b5_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.936
id2_i5_o5_false-unreach-call.c [OCRS][without] 2 PASS
0.418
id2_i5_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.419
id_b2_o3_true-unreach-call.c [OCRS][without] 2 PASS
0.567
id_b3_o2_false-unreach-call.c [OCRS][without] 2 PASS
0.587
id_b3_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.577
id_b5_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.588
id_i10_o10_false-unreach-call.c [OCRS][without] 2 PASS
0.385
id_i10_o10_true-unreach-call.c [OCRS][without] 2 PASS
0.378
id_i15_o15_false-unreach-call.c [OCRS][without] 2 PASS
0.377
id_i15_o15_true-unreach-call.c [OCRS][without] 2 PASS
0.382
id_i20_o20_false-unreach-call.c [OCRS][without] 2 PASS
0.372
id_i20_o20_true-unreach-call.c [OCRS][without] 2 PASS
0.385
id_i25_o25_false-unreach-call.c [OCRS][without] 2 PASS
0.369
id_i25_o25_true-unreach-call.c [OCRS][without] 2 PASS
0.367
id_i5_o5_false-unreach-call.c [OCRS][without] 2 PASS
0.38
id_i5_o5_true-unreach-call.c [OCRS][without] 2 PASS
0.375
id_o1000_false-unreach-call.c [OCRS][without] 2 PASS
0.377
id_o100_false-unreach-call.c [OCRS][without] 2 PASS
0.368
id_o10_false-unreach-call.c [OCRS][without] 2 PASS
0.378
id_o200_false-unreach-call.c [OCRS][without] 2 PASS
0.382
id_o20_false-unreach-call.c [OCRS][without] 2 PASS
0.378
id_o3_false-unreach-call.c [OCRS][without] 2 PASS
0.38
sum_10x0_false-unreach-call.c [OCRS][without] 2 PASS
0.402
sum_10x0_true-unreach-call.c [OCRS][without] 2 PASS
0.376
sum_15x0_false-unreach-call.c [OCRS][without] 2 PASS
0.392
sum_15x0_true-unreach-call.c [OCRS][without] 2 PASS
0.379
sum_20x0_false-unreach-call.c [OCRS][without] 2 PASS
0.407
sum_20x0_true-unreach-call.c [OCRS][without] 2 PASS
0.384
sum_25x0_false-unreach-call.c [OCRS][without] 2 PASS
0.404
sum_25x0_true-unreach-call.c [OCRS][without] 2 PASS
0.393
sum_2x3_false-unreach-call.c [OCRS][without] 2 PASS
0.397
sum_2x3_true-unreach-call.c [OCRS][without] 2 PASS
0.376
sum_non_eq_false-unreach-call.c [OCRS][without] 2 PASS
0.421
sum_non_eq_true-unreach-call.c [OCRS][without] 2 PASS
0.399
sum_non_false-unreach-call.c [OCRS][without] 2 PASS
0.398
sum_non_true-unreach-call.c [OCRS][without] 2 PASS
0.373
Total Below Time = 339.444 (was 5954.819)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-lit
rec-afnp2014_true-unreach-call.c [OCRS][without] 2 PASS
0.395
rec-bhmr2007_true-unreach-call.c [OCRS][without] 2 PASS
0.404
rec-cggmp2005b_true-unreach-call.c [OCRS][without] 3 PASS
0.729
rec-cggmp2005_true-unreach-call.c [OCRS][without] 2 PASS
0.341
rec-cggmp2005_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.345
rec-css2003_true-unreach-call.c [OCRS][without] 2 PASS
0.619
rec-ddlm2013_true-unreach-call.c [OCRS][without] EXCEPTION
0.343 (0.455)
rec-gcnr2008_false-unreach-call.c [OCRS][without] 2 PASS
0.842
rec-gj2007b_true-unreach-call.c [OCRS][without] 2 FAIL
FAIL
0.389
rec-gj2007_true-unreach-call.c [OCRS][without] 2 FAIL
0.398
rec-gr2006_true-unreach-call.c [OCRS][without] 2 FAIL
0.393
rec-gsv2008_true-unreach-call.c [OCRS][without] 2 PASS
0.351
rec-hhk2008_true-unreach-call.c [OCRS][without] 2 PASS
0.335
rec-jm2006_true-unreach-call.c [OCRS][without] 2 PASS
0.378
rec-jm2006_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.388
rec-mcmillan2006_true-unreach-call.c [OCRS][without] 2 FAIL
0.428
Total Below Time = 7.078 (was 7.077)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-new
rec-count_by_1_true-unreach-call.c [OCRS][without] 2 PASS
0.334
rec-count_by_1_variant_true-unreach-call.c [OCRS][without] 2 PASS
0.345
rec-count_by_2_true-unreach-call.c [OCRS][without] 2 PASS
0.339
rec-count_by_k_true-unreach-call.c [OCRS][without] 2 PASS
0.357
rec-count_by_nondet_true-unreach-call.c [OCRS][without] 2 FAIL
0.372
rec-gauss_sum_true-unreach-call.c [OCRS][without] 2 PASS
0.358
rec-half_true-unreach-call.c [OCRS][without] EXCEPTION
0.331 (0.39)
rec-nested_true-unreach-call.c [OCRS][without] 3 PASS
0.59
Total Below Time = 3.026 (was 3.094)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/recurrences
cubic_polynomial.c [OCRS][without] 2 PASS
0.528
edit_distance_bottom_up.c [OCRS][without] 3 FAIL
295.578
edit_distance_top_down.c [OCRS][without] 3 FAIL
49.765
log_log_n_solution.c [OCRS][without] 3 FAIL
0.431 (0.844)
log_n_solution.c [OCRS][without] 2 FAIL
0.441
multivariate_1.c [OCRS][without] TIMEOUT
300.007
multivariate_higher_order.c [OCRS][without] 7 FAIL
FAIL
FAIL
25.532
n_cubed_solution.c [OCRS][without] EXCEPTION
0.33
n_log_n_solution.c [OCRS][without] TIMEOUT
300.038 (1.825)
n_squared_two_base_case_even.c [OCRS][without] 2 PASS
0.426 (0.381)
n_squared_two_base_case_odd.c [OCRS][without] 2 PASS
0.578 (0.376)
pascals_dynamic.c [OCRS][without] 3 FAIL
21.098
pascals_iterative.c [OCRS][without] 1 FAIL
5.334 (6.285)
pascals_recursive.c [OCRS][without] TIMEOUT
300.005
squared_solution.c [OCRS][without] TIMEOUT
300.138 (12.144)
two_n_even.c [OCRS][without] 2 PASS
0.389
two_n_odd.c [OCRS][without] 2 PASS
0.388
two_to_n_over_two_even.c [OCRS][without] TIMEOUT
300.032 (44.898)
two_to_n_over_two_odd.c [OCRS][without] TIMEOUT
300.021 (44.337)
two_to_n_squared.c [OCRS][without] 8 TIMEOUT
300.005 (133.773)
two_to_two_to_n.c [OCRS][without] 7 FAIL
1.617
Total Below Time = 2502.681 (was 1246.702)
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/exponential
adding_and_mult.c [OCRS][without] 1 PASS
0.323
exp_add_loop_rec.c [OCRS][without] 1 FAIL
0.453 (0.342)
exp_add_loop_variable.c [OCRS][without] 1 PASS
0.41 (0.357)
exp_with_linear_inner_loop.c [OCRS][without] 1 FAIL
0.444 (0.391)
linear_two_to_n.c [OCRS][without] 8 FAIL
1.528 (1.387)
loop_five_to_n.c [OCRS][without] 1 FAIL
0.357
non_loop_five_to_n.c [OCRS][without] 8 FAIL
10.064 (8.708)
power_log.c [OCRS][without] 1 PASS
0.413 (0.371)
power_log_modified.c [OCRS][without] 1 PASS
0.476 (0.395)
simple_exponential.c [OCRS][without] 1 PASS
0.325
simple_exponential_for.c [OCRS][without] 1 PASS
0.344
two_to_n_minus_n.c [OCRS][without] 8 FAIL
1.787
two_to_n_minus_n_loop.c [OCRS][without] 8 FAIL
2.689
Total Below Time = 19.613 (was 17.624)

>25% better
25%-10% better
No significant change
10%-25% worse
>25% worse