[Version Information]
WALi-OpenNWA version: 088075c428c89531f84bc48ca70e4f182df9184b (2017-08-09 10:53:57 -0500) "the scripts used for POPL18 submission and fixed soundness errors for nightly run"
duet version: 0bb65ddfee3d65b76cb927b278e492b410b1c720 (2017-08-06 18:12:28 -0400) "Merge remote-tracking branch 'origin/ark2' into Newton-ark2"
# Installed packages for 4.02.1+PIC:
apron              20160125  APRON numerical abstract domain library
base-bigarray          base  Bigarray library distributed with the OCaml compile
base-bytes             base  Bytes library distributed with the OCaml compiler
base-num               base  Num library distributed with the OCaml compiler
base-ocamlbuild        base  OCamlbuild binary and libraries distributed with th
base-threads           base  Threads library distributed with the OCaml compiler
base-unix              base  Unix library distributed with the OCaml compiler
batteries             2.5.3  a community-maintained standard library extension
camlidl                1.05  Stub code generator for OCaml
camlp4               4.02+7  Camlp4 is a system for writing extensible parsers f
cil                20150825  A front-end for the C programming language that fac
conf-gmp                  1  Virtual package relying on a GMP lib system install
conf-m4                   1  Virtual package relying on m4
conf-mathsat              1  Virtual package relying on a MathSAT system install
conf-mpfr                 1  Virtual package relying on library MPFR installatio
conf-perl                 1  Virtual package relying on perl
conf-python-2-7         1.0  Virtual package relying on Python-2.7 installation.
conf-which                1  Virtual package relying on which
cppo                  1.4.1  Equivalent of the C preprocessor for OCaml programs
deriving           20140904  Extension to OCaml for deriving functions from type
mathsat            20161206  MathSAT 5 SMT solver
menhir             20170101  LR(1) parser generator
mlgmpidl              1.2.4  OCaml interface to the GMP library
num                       0  The Num library for arbitrary-precision integer and
oasis                 0.4.8  Tooling for building OCaml libraries and applicatio
ocamlbuild                0  Build system distributed with the OCaml compiler si
ocamlfind             1.7.1  A library manager for OCaml
ocamlgraph            1.8.7  A generic graph library for OCaml
ocamlify              0.0.1  Include files in OCaml code
ocamlmod              0.0.8  Generate OCaml modules from source files
OCRS             20170627v3  Recurrence solver based on operational calculus
optcomp                 1.6  Optional compilation with cpp-like directives
ounit                 2.0.0  Unit testing framework loosely based on HUnit. It i
ppx_deriving            4.1  Type-driven code generation for OCaml >=4.02
ppx_tools        5.0+4.02.0  Tools for authors of ppx rewriters and other syntac
result                  1.2  Compatibility Result module
Z3                 20161217  Z3 SMT solver

Test Name Output No. of Rounds Result Run Time
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/c4b
gcd.c below 1 FAIL0.37
kmp.c below 1 PASS1.124
qsort.c below 4 PASS1.013
speed_pldi09_fig1.c below 1 PASS0.506
speed_pldi09_fig4_2.c below 1 FAIL0.391
speed_pldi09_fig4_4.c below 1 PASS4.848
speed_pldi09_fig4_5.c below 1 PASS0.403
speed_pldi10_ex1.c below 1 PASS1.792
speed_pldi10_ex3.c below 1 PASS0.521
speed_pldi10_ex4.c below 1 PASS0.557
speed_popl10_fig2_1.c below 1 PASS0.457
speed_popl10_fig2_2.c below 1 FAIL0.377
speed_popl10_nested_multiple.c below 1 PASS0.484
speed_popl10_nested_single.c below 1 PASS0.44
speed_popl10_sequential_single.c below 1 PASS0.405
speed_popl10_simple_multiple.c below 1 PASS0.499
speed_popl10_simple_single_2.c below 1 PASS0.605
speed_popl10_simple_single.c below 1 PASS0.359
t07.c below 1 PASS0.425
t08.c below 1 PASS0.393
t09.c below 1 PASS0.385
t10.c below 1 PASS0.382
t11.c below 1 PASS0.495
t13.c below 1 FAIL0.503
t15.c below 1 PASS0.433
t16.c below 1 PASS0.41
t19.c below 1 PASS0.405
t20.c below 1 PASS0.379
t27.c below 1 PASS0.566
t28.c below 1 PASS0.463
t30.c below 1 FAIL0.433
t37.c below 2 PASS0.621
t39.c below 2 PASS0.569
t46.c below 1 PASS0.404
t47.c below 1 FAIL0.567
ICRA Assertions (True) = 29/35
ICRA Assertions (False) = 0/0
ICRA Time = 22.984
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/misc-recursive
mult-rec.c below 2 PASS0.383
qsort_full.c below 4 PASS11.328
rec1-param_safe.c below 2 PASS0.38
rec1-param_unsafe.c below 2 OKAY0.405
rec1_safe.c below 2 PASS0.377
rec1_unsafe.c below 2 OKAY0.358
rec2-param_safe.c below 2 PASS0.38
rec2-param_unsafe.c below 2 OKAY0.379
rec2_safe.c below 2 PASS0.438
rec2_unsafe.c below 2 OKAY0.357
rec-test.c below 2 PASS0.366
sas03_bothbranches.c below 7 PASS0.879
sas03.c below 2 PASS0.743
simulated_lese_recursive.c below 2 PASS0.465
ICRA Assertions (True) = 10/10
ICRA Assertions (False) = 4/4
ICRA Time = 17.238
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/duet
count_up_down_safe.c below 1 PASS0.345
count_up_down_unsafe.c below 1 OKAY0.342
divide.c below 1 PASS0.352
factor_unsafe.c below 1 OKAY0.328
for_infinite_loop_1_safe.c below 1 PASS0.32
for_infinite_loop_2_safe.c below 1 PASS0.331
interproc.c below 1 PASS0.307
mult.c below 1 PASS0.345
pointer_arith.c below 1 PASS0.32
quotient.c below 3 PASS0.475
subtract.c below 1 PASS0.318
sum01_bug02_sum01_bug02_base.case_unsafe.c below 1 OKAY0.358
sum01_bug02_unsafe.c below 1 OKAY0.614
sum01_real_safe.c below 1 PASS0.336
sum01_safe.c below 1 PASS0.347
sum01_unsafe.c below 1 OKAY0.463
sum02_safe.c below 1 PASS0.361
sum03_safe.c below 1 PASS0.407
sum03_unsafe.c below 1 OKAY0.484
sum04_safe.c below 1 PASS0.347
sum04_unsafe.c below 1 OKAY0.473
terminator_02_safe.c below 1 PASS0.335
terminator_02_unsafe.c below 1 OKAY0.367
terminator_03_safe.c below 1 PASS0.335
terminator_03_unsafe.c below 1 OKAY0.35
token_ring01_safe.c below 4 FAIL207.918
token_ring01_unsafe.c below 4 TIMEOUT 300.007
toy_safe.c below EXCEPTION 161.475
trex01_safe.c below 1 PASS0.744
trex01_unsafe.c below 1 OKAY0.384
trex02_safe2.c below 3 PASS0.403
trex02_safe.c below 3 PASS0.396
trex02_unsafe.c below 3 OKAY0.415
trex03_safe.c below 1 PASS0.457
trex03_unsafe.c below 1 OKAY0.434
trex04_safe.c below 1 PASS0.35
while_infinite_loop_1_safe.c below 1 PASS0.304
while_infinite_loop_2_safe.c below 1 PASS0.315
while_infinite_loop_3_safe.c below 1 PASS0.305
ICRA Assertions (True) = 24/26
ICRA Assertions (False) = 12/13
ICRA Time = 683.267
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests
above_litmus.c below 3 PASS0.417
blogger_simplified1.c below 3 PASS1.191
divided_difference2.c below TIMEOUT 300.004
mult-proc.c below 3 PASS0.373
mult-proc-params.c below 3 PASS0.397
popall.c below 1 PASS0.678
simulated_scc.c below 1 PASS0.674
ICRA Assertions (True) = 6/7
ICRA Assertions (False) = 0/0
ICRA Time = 303.734
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/polynomial/assert
degree1_monomial.c below 1 PASS0.363
degree2_binomial.c below 1 FAIL0.888
degree2_monomial.c below 1 PASS0.397
degree3_binomial.c below 1 FAIL2.033
degree3_monomial.c below 1 PASS0.471
degree4_binomial.c below 1 FAIL8.188
degree4_monomial.c below 1 PASS0.555
degree5_binomial.c below 1 FAIL189.968
degree5_monomial.c below 1 PASS0.652
ICRA Assertions (True) = 5/9
ICRA Assertions (False) = 0/0
ICRA Time = 203.515
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/snlee/snlee_tests
cubic_with_square.c below 1 PASS0.461
cubic_with_square_interproc.c below 2 PASS0.618
cubic_with_square_nonlinear.c below 1 FAIL0.401
cubic_with_square_nonlinear_interproc.c below 2 FAIL0.434
cubic_with_square_nonlinear_unsafe.c below 1 OKAY0.388
cubic_with_square_unsafe.c below 1 OKAY0.445
multi-input.c below 1 PASS0.488
multi-input_unsafe.c below 1 OKAY0.542
nondet_loop_bound.c below 1 FAIL0.363
nondet_loop_bound_quartic.c below 1 FAIL0.383
nondet_loop_bound_quartic_unsafe.c below 1 OKAY0.377
nondet_loop_bound_unsafe.c below 1 OKAY0.368
nonlinear_stratified.c below 1 TIMEOUT300.004
nonlinear_stratified_unsafe.c below 1 OKAY0.722
quartic_with_cube.c below 1 PASS0.64
quartic_with_cube_nonlinear.c below 1 FAIL0.417
quartic_with_cube_nonlinear_unsafe.c below 1 OKAY0.42
quartic_with_cube_unsafe.c below 1 OKAY0.515
quintic_with_quartic.c below 1 PASS1.049
quintic_with_quartic_nonlinear.c below 1 PASS2.906
quintic_with_quartic_nonlinear_unsafe.c below 1 OKAY0.562
quintic_with_quartic_unsafe.c below 1 OKAY1.006
ICRA Assertions (True) = 6/12
ICRA Assertions (False) = 10/10
ICRA Time = 313.509
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/FiniteDifferencing
degree2.c below 1 PASS0.718
degree2_FD_AllAux_AllAssm.c below 1 PASS102.102
degree2_FD_AllAux_FewAssm.c below 1 PASS7.059
degree2_FD_FewAux_FewAssm.c below 1 PASS1.014
degree2_FD_FewAux_FewAssm_NonLinAsrt.c below 1 PASS1.01
degree3.c below 1 PASS0.772
degree3_FD.c below 1 PASS0.911
degree4.c below 1 PASS0.458
ICRA Assertions (True) = 8/8
ICRA Assertions (False) = 0/0
ICRA Time = 114.044
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LESE
loop.c below 1 PASS0.441
loop_unsafe.c below 1 OKAY0.454
simulated_lese_parser.c below 1 PASS0.355
simulated_lese_sentinel.c below 1 PASS0.355
ICRA Assertions (True) = 3/3
ICRA Assertions (False) = 1/1
ICRA Time = 1.605
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LowerBound
lower_bound.c below 1 PASS0.345
ICRA Assertions (True) = 1/1
ICRA Assertions (False) = 0/0
ICRA Time = 0.345
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LZ
lz77.c below EXCEPTION 113.976
ICRA Assertions (True) = 0/1
ICRA Assertions (False) = 0/0
ICRA Time = 113.976
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-acceleration
array_false-unreach-call1.c below 1 OKAY0.35
array_false-unreach-call2.c below 1 OKAY0.375
array_false-unreach-call3.c below 1 OKAY0.344
array_true-unreach-call1.c below 1 FAIL0.354
array_true-unreach-call2.c below 1 FAIL0.383
array_true-unreach-call3.c below 1 PASS0.336
array_true-unreach-call4.c below 1 FAIL0.339
const_false-unreach-call1.c below 1 OKAY0.345
const_true-unreach-call1.c below 1 PASS0.346
diamond_false-unreach-call1.c below 1 OKAY0.36
diamond_true-unreach-call1.c below 1 PASS0.34
diamond_true-unreach-call2.c below 1 PASS0.361
functions_false-unreach-call1.c below 3 OKAY0.384
functions_true-unreach-call1.c below 3 PASS0.38
multivar_false-unreach-call1.c below 1 OKAY0.36
multivar_true-unreach-call1.c below 1 PASS0.352
nested_false-unreach-call1.c below 1 OKAY0.368
nested_true-unreach-call1.c below 1 PASS0.37
overflow_true-unreach-call1.c below 1 PASS0.327
phases_false-unreach-call1.c below 1 OKAY0.404
phases_false-unreach-call2.c below 1 OKAY0.346
phases_true-unreach-call1.c below 1 PASS0.4
phases_true-unreach-call2.c below 1 PASS0.341
simple_false-unreach-call1.c below 1 OKAY0.318
simple_false-unreach-call2.c below 1 OKAY0.316
simple_false-unreach-call3.c below 1 OKAY0.351
simple_false-unreach-call4.c below 1 OKAY0.328
simple_true-unreach-call1.c below 1 PASS0.329
simple_true-unreach-call2.c below 1 PASS0.371
simple_true-unreach-call3.c below 1 PASS0.322
simple_true-unreach-call4.c below 1 PASS0.317
underapprox_false-unreach-call1.c below 1 OKAY0.355
underapprox_false-unreach-call2.c below 1 OKAY0.348
underapprox_true-unreach-call1.c below 1 FAIL0.356
underapprox_true-unreach-call2.c below 1 PASS0.373
ICRA Assertions (True) = 15/19
ICRA Assertions (False) = 16/16
ICRA Time = 12.349
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-invgen
apache-escape-absolute_true-unreach-call.c below 1 PASS0.876
apache-get-tag_true-unreach-call.c below 1 FAIL0.44
down_true-unreach-call.c below 1 PASS0.358
fragtest_simple_true-unreach-call.c below 1 PASS0.442
half_2_true-unreach-call.c below 1 PASS0.395
heapsort_true-unreach-call.c below 1 PASS3.184
id_build_true-unreach-call.c below 1 PASS0.369
id_trans_false-unreach-call.c below 1 OKAY0.326
id_trans_true-unreach-call.c below 1 PASS0.342
large_const_true-unreach-call.c below 1 PASS0.428
MADWiFi-encode_ie_ok_true-unreach-call.c below 1 PASS0.375
nested6_true-unreach-call.c below 1 FAIL0.533
nested9_true-unreach-call.c below 1 PASS0.545
nest-if3_true-unreach-call.c below 1 PASS0.495
NetBSD_loop_true-unreach-call.c below 1 PASS0.333
sendmail-close-angle_true-unreach-call.c below 1 FAIL0.415
seq_true-unreach-call.c below 1 PASS0.419
SpamAssassin-loop_true-unreach-call.c below 1 PASS1.49
string_concat-noarr_true-unreach-call.c below 1 PASS0.402
up_true-unreach-call.c below 1 PASS0.386
ICRA Assertions (True) = 16/19
ICRA Assertions (False) = 1/1
ICRA Time = 12.553
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-lit
afnp2014_true-unreach-call.c below 1 PASS0.372
bhmr2007_true-unreach-call.c below 1 PASS0.382
cggmp2005b_true-unreach-call.c below 1 PASS0.495
cggmp2005_true-unreach-call.c below 1 PASS0.348
cggmp2005_variant_true-unreach-call.c below 1 PASS0.358
css2003_true-unreach-call.c below 1 PASS0.775
ddlm2013_true-unreach-call.c below 1 PASS0.508
gcnr2008_false-unreach-call.c below 1 OKAY0.96
gj2007b_true-unreach-call.c below 1 FAIL0.387
gj2007_true-unreach-call.c below 1 PASS0.435
gr2006_true-unreach-call.c below 1 PASS0.414
gsv2008_true-unreach-call.c below 1 PASS0.345
hhk2008_true-unreach-call.c below 1 PASS0.377
jm2006_true-unreach-call.c below 1 PASS0.412
jm2006_variant_true-unreach-call.c below 1 PASS0.446
mcmillan2006_true-unreach-call.c below 1 FAIL0.393
ICRA Assertions (True) = 13/15
ICRA Assertions (False) = 1/1
ICRA Time = 7.407
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-new
count_by_1_true-unreach-call.c below 1 PASS0.327
count_by_1_variant_true-unreach-call.c below 1 PASS0.382
count_by_2_true-unreach-call.c below 1 PASS0.324
count_by_k_true-unreach-call.c below 1 PASS0.345
count_by_nondet_true-unreach-call.c below 1 FAIL0.362
gauss_sum_true-unreach-call.c below 1 PASS0.375
half_true-unreach-call.c below 1 FAIL0.365
nested_true-unreach-call.c below 1 PASS0.407
ICRA Assertions (True) = 6/8
ICRA Assertions (False) = 0/0
ICRA Time = 2.887
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loops
array_false-unreach-call.c below 1 OKAY0.393
array_true-unreach-call.c below 1 FAIL0.388
bubble_sort_false-unreach-call.c below 4 OKAY72.748
bubble_sort_true-unreach-call.c below 1 PASS5.163
compact_false-unreach-call.c below 1 OKAY0.382
count_up_down_false-unreach-call_true-termination.c below 1 OKAY0.33
count_up_down_true-unreach-call_true-termination.c below 1 PASS0.34
eureka_01_false-unreach-call.c below 1 OKAY2.273
eureka_01_true-unreach-call.c below 1 FAIL1.601
eureka_05_true-unreach-call.c below 1 FAIL0.749
for_bounded_loop1_false-unreach-call_true-termination.c below 1 OKAY0.342
for_bounded_loop1_true-unreach-call_true-termination.c below 1 PASS0.337
for_infinite_loop_1_true-unreach-call_false-termination.c below 1 PASS0.316
for_infinite_loop_2_true-unreach-call_false-termination.c below 1 PASS0.327
heavy_false-unreach-call.c below 1 OKAY0.516
heavy_true-unreach-call.c below 1 PASS0.496
insertion_sort_false-unreach-call.c below 1 OKAY2.4
insertion_sort_true-unreach-call.c below 1 FAIL0.591
invert_string_false-unreach-call.c below 1 OKAY0.502
invert_string_true-unreach-call.c below 1 FAIL0.528
linear_sea.ch_true-unreach-call.c below 1 FAIL0.388
linear_search_false-unreach-call.c below 1 OKAY0.373
lu.cmp_true-unreach-call.c below 3 PASS63.66
ludcmp_false-unreach-call.c below 3 OKAY64.224
matrix_false-unreach-call_true-termination.c below 1 OKAY1.112
matrix_true-unreach-call_true-termination.c below 1 FAIL0.469
n.c11_true-unreach-call.c below 3 FAIL0.441
n.c24_false-unreach-call.c below 3 OKAY5.488
n.c40_true-unreach-call.c below 1 FAIL0.352
nec11_false-unreach-call.c below 1 OKAY0.361
nec20_false-unreach-call.c below 1 OKAY0.384
nec40_true-unreach-call.c below 1 FAIL0.374
string_false-unreach-call.c below 1 OKAY0.649
string_true-unreach-call.c below 1 FAIL0.641
sum01_bug02_false-unreach-call_true-termination.c below 1 OKAY0.597
sum01_bug02_sum01_bug02_base.case_false-unreach-call_true-termination.c below 1 OKAY0.332
sum01_false-unreach-call_true-termination.c below 1 OKAY0.46
sum01_true-unreach-call_true-termination.c below 1 PASS0.365
sum03_false-unreach-call_true-termination.c below 1 OKAY0.502
sum03_true-unreach-call_false-termination.c below 1 PASS0.422
sum04_false-unreach-call_true-termination.c below 1 OKAY0.472
sum04_true-unreach-call_true-termination.c below 1 PASS0.349
sum_array_false-unreach-call.c below 1 OKAY0.63
sum_array_true-unreach-call.c below 1 FAIL0.701
terminator_01_false-unreach-call_false-termination.c below 1 OKAY0.318
terminator_02_false-unreach-call_true-termination.c below 3 OKAY0.459
terminator_02_true-unreach-call_true-termination.c below 2 PASS0.341
terminator_03_false-unreach-call_true-termination.c below 1 OKAY0.327
terminator_03_true-unreach-call_true-termination.c below 1 PASS0.325
trex01_false-unreach-call_true-termination.c below 3 OKAY0.451
trex01_true-unreach-call.c below 3 PASS0.71
trex02_false-unreach-call_true-termination.c below 3 OKAY0.414
trex02_true-unreach-call_true-termination.c below 3 PASS0.423
trex03_false-unreach-call_true-termination.c below 3 OKAY0.681
trex03_true-unreach-call.c below 3 PASS0.673
trex04_true-unreach-call_false-termination.c below 1 PASS0.369
veris.c_NetBSD-libc__loop_true-unreach-call.c below 1 PASS0.354
veris.c_OpenSER__cases1_stripFullBoth_arr_true-unreach-call.c below 3 PASS11.759
veris.c_sendmail__tTflag_arr_one_loop_true-unreach-call.c below 1 PASS0.379
verisec_NetBSD-libc__loop_false-unreach-call.c below 1 OKAY0.361
verisec_OpenSER__cases1_stripFullBoth_arr_false-unreach-call.c below 3 OKAY7.571
vogal_false-unreach-call.c below 1 OKAY0.768
vogal_true-unreach-call.c below 1 FAIL0.776
while_infinite_loop_1_true-unreach-call_false-termination.c below 1 PASS0.312
while_infinite_loop_2_true-unreach-call_false-termination.c below 1 PASS0.3
while_infinite_loop_3_true-unreach-call_false-termination.c below 1 PASS0.308
while_infinite_loop_4_false-unreach-call_true-termination.c below 1 OKAY0.326
ICRA Assertions (True) = 22/35
ICRA Assertions (False) = 32/32
ICRA Time = 263.173
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive
Ackermann01_true-unreach-call.c below 7 PASS1.305
Ackermann02_false-unreach-call_false-termination.c below 7 OKAY1.244
Ackermann03_true-unreach-call.c below 7 FAIL1.337
Ackermann04_true-unreach-call.c below 7 FAIL1.291
Addition01_true-unreach-call_true-termination.c below 2 PASS0.579
Addition02_false-unreach-call_false-termination.c below 2 OKAY0.568
Addition03_false-no-overflow.c below 2 PASS0.602
Addition03_true-unreach-call.c below 2 PASS0.598
BallRajamani-SPIN2000-Fig1_false-unreach-call.c below 2 OKAY0.484
EvenOdd01_true-unreach-call_true-termination.c below 2 PASS0.437
EvenOdd03_false-unreach-call_false-termination.c below 2 OKAY0.433
Fibonacci01_true-unreach-call.c below 7 FAIL0.843
Fibonacci02_true-unreach-call_true-termination.c below 7 FAIL0.83
Fibonacci03_true-unreach-call_true-termination.c below 7 FAIL0.865
Fibonacci04_false-unreach-call_true-termination.c below 7 OKAY0.838
Fibonacci05_false-unreach-call_true-termination.c below 7 OKAY0.85
gcd01_true-unreach-call_true-termination.c below 2 PASS0.571
gcd02_true-unreach-call.c below 2 FAIL1.135
McCarthy91_false-unreach-call_false-termination.c below 7 OKAY0.965
McCarthy91_true-unreach-call.c below 7 FAIL0.979
MultCommutative_true-unreach-call_true-termination.c below 2 FAIL0.61
Primes_true-unreach-call.c below 3 FAIL1.619
recHanoi01_true-unreach-call_true-termination.c below 8 FAIL46.27
recHanoi02_true-unreach-call_true-termination.c below 2 FAIL0.391
recHanoi03_true-unreach-call_true-termination.c below 2 FAIL0.392
ICRA Assertions (True) = 6/18
ICRA Assertions (False) = 7/7
ICRA Time = 66.036
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive-simple
afterrec_2calls_false-unreach-call.c below 2 OKAY0.416
afterrec_2calls_true-unreach-call.c below 2 PASS0.412
afterrec_false-unreach-call.c below 2 OKAY0.383
afterrec_true-unreach-call.c below 2 PASS0.357
fibo_10_false-unreach-call.c below 7 OKAY0.833
fibo_10_true-unreach-call.c below 7 FAIL0.82
fibo_15_false-unreach-call.c below 7 OKAY0.851
fibo_15_true-unreach-call.c below 7 FAIL0.836
fibo_20_false-unreach-call.c below 7 OKAY0.834
fibo_20_true-unreach-call.c below 7 FAIL0.813
fibo_25_false-unreach-call.c below 7 OKAY0.862
fibo_25_true-unreach-call.c below 7 FAIL0.855
fibo_2calls_10_false-unreach-call.c below TIMEOUT 300.018
fibo_2calls_10_true-unreach-call.c below TIMEOUT 300.021
fibo_2calls_15_false-unreach-call.c below TIMEOUT 300.024
fibo_2calls_15_true-unreach-call.c below TIMEOUT 300.024
fibo_2calls_20_false-unreach-call.c below TIMEOUT 300.019
fibo_2calls_20_true-unreach-call.c below TIMEOUT 300.024
fibo_2calls_25_false-unreach-call.c below TIMEOUT 300.025
fibo_2calls_25_true-unreach-call.c below TIMEOUT 300.019
fibo_2calls_2_false-unreach-call.c below TIMEOUT 300.023
fibo_2calls_2_true-unreach-call.c below TIMEOUT 300.023
fibo_2calls_4_false-unreach-call.c below TIMEOUT 300.022
fibo_2calls_4_true-unreach-call.c below TIMEOUT 300.024
fibo_2calls_5_false-unreach-call.c below TIMEOUT 300.023
fibo_2calls_5_true-unreach-call.c below TIMEOUT 300.021
fibo_2calls_6_false-unreach-call.c below TIMEOUT 300.023
fibo_2calls_6_true-unreach-call.c below TIMEOUT 300.022
fibo_2calls_8_false-unreach-call.c below TIMEOUT 300.021
fibo_2calls_8_true-unreach-call.c below TIMEOUT 300.023
fibo_5_false-unreach-call.c below 7 OKAY0.808
fibo_5_true-unreach-call.c below 7 FAIL0.879
fibo_7_false-unreach-call.c below 7 OKAY0.867
fibo_7_true-unreach-call.c below 7 FAIL0.808
id2_b2_o3_true-unreach-call.c below 2 PASS0.697
id2_b3_o2_false-unreach-call.c below 2 OKAY0.717
id2_b3_o5_true-unreach-call.c below 2 PASS0.7
id2_b5_o10_true-unreach-call.c below 2 PASS0.749
id2_i5_o5_false-unreach-call.c below 2 OKAY0.426
id2_i5_o5_true-unreach-call.c below 2 PASS0.45
id_b2_o3_true-unreach-call.c below 2 PASS0.609
id_b3_o2_false-unreach-call.c below 2 OKAY0.606
id_b3_o5_true-unreach-call.c below 2 PASS0.623
id_b5_o10_true-unreach-call.c below 2 PASS0.629
id_i10_o10_false-unreach-call.c below 2 OKAY0.413
id_i10_o10_true-unreach-call.c below 2 PASS0.395
id_i15_o15_false-unreach-call.c below 2 OKAY0.391
id_i15_o15_true-unreach-call.c below 2 PASS0.393
id_i20_o20_false-unreach-call.c below 2 OKAY0.387
id_i20_o20_true-unreach-call.c below 2 PASS0.394
id_i25_o25_false-unreach-call.c below 2 OKAY0.386
id_i25_o25_true-unreach-call.c below 2 PASS0.386
id_i5_o5_false-unreach-call.c below 2 OKAY0.382
id_i5_o5_true-unreach-call.c below 2 PASS0.381
id_o1000_false-unreach-call.c below 2 OKAY0.399
id_o100_false-unreach-call.c below 2 OKAY0.406
id_o10_false-unreach-call.c below 2 OKAY0.385
id_o200_false-unreach-call.c below 2 OKAY0.396
id_o20_false-unreach-call.c below 2 OKAY0.396
id_o3_false-unreach-call.c below 2 OKAY0.389
sum_10x0_false-unreach-call.c below 2 OKAY0.413
sum_10x0_true-unreach-call.c below 2 PASS0.428
sum_15x0_false-unreach-call.c below 2 OKAY0.432
sum_15x0_true-unreach-call.c below 2 PASS0.418
sum_20x0_false-unreach-call.c below 2 OKAY0.431
sum_20x0_true-unreach-call.c below 2 PASS0.413
sum_25x0_false-unreach-call.c below 2 OKAY0.439
sum_25x0_true-unreach-call.c below 2 PASS0.428
sum_2x3_false-unreach-call.c below 2 OKAY0.433
sum_2x3_true-unreach-call.c below 2 PASS0.412
sum_non_eq_false-unreach-call.c below 2 OKAY0.428
sum_non_eq_true-unreach-call.c below 2 PASS0.431
sum_non_false-unreach-call.c below 2 OKAY0.437
sum_non_true-unreach-call.c below 2 PASS0.444
ICRA Assertions (True) = 21/36
ICRA Assertions (False) = 29/38
ICRA Time = 5430.505
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-lit
rec-afnp2014_true-unreach-call.c below 2 PASS0.415
rec-bhmr2007_true-unreach-call.c below 2 PASS0.428
rec-cggmp2005b_true-unreach-call.c below 3 PASS0.698
rec-cggmp2005_true-unreach-call.c below 2 PASS0.373
rec-cggmp2005_variant_true-unreach-call.c below 2 PASS0.431
rec-css2003_true-unreach-call.c below 2 PASS1.015
rec-ddlm2013_true-unreach-call.c below TIMEOUT 300.005
rec-gcnr2008_false-unreach-call.c below 2 OKAY0.842
rec-gj2007b_true-unreach-call.c below 2 FAIL0.388
rec-gj2007_true-unreach-call.c below 2 FAIL0.478
rec-gr2006_true-unreach-call.c below 2 FAIL0.441
rec-gsv2008_true-unreach-call.c below 2 PASS0.425
rec-hhk2008_true-unreach-call.c below 2 PASS0.384
rec-jm2006_true-unreach-call.c below 2 PASS0.45
rec-jm2006_variant_true-unreach-call.c below 2 PASS0.509
rec-mcmillan2006_true-unreach-call.c below 2 FAIL0.435
ICRA Assertions (True) = 10/15
ICRA Assertions (False) = 1/1
ICRA Time = 307.717
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-new
rec-count_by_1_true-unreach-call.c below 2 PASS0.36
rec-count_by_1_variant_true-unreach-call.c below 2 PASS0.391
rec-count_by_2_true-unreach-call.c below 2 PASS0.352
rec-count_by_k_true-unreach-call.c below 2 PASS0.383
rec-count_by_nondet_true-unreach-call.c below 2 FAIL0.395
rec-gauss_sum_true-unreach-call.c below 2 PASS0.436
rec-half_true-unreach-call.c below 2 FAIL0.418
rec-nested_true-unreach-call.c below 3 FAIL0.564
ICRA Assertions (True) = 5/8
ICRA Assertions (False) = 0/0
ICRA Time = 3.299
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/recurrences
cubic_polynomial.c below 2 PASS0.538
cubic_polynomial_unsafe.c below 2 OKAY0.572
edit_distance_bottom_up.c below 3 FAIL192.177
edit_distance_top_down.c below 3 FAIL4.461
log_log_n_solution.c below 3 FAIL0.466
log_log_n_solution_unsafe.c below 3 OKAY0.474
log_n_solution.c below 2 FAIL0.471
log_n_solution_unsafe.c below 2 OKAY0.478
multivariate_1.c below TIMEOUT 300.006
multivariate_1_unsafe.c below TIMEOUT 300.006
multivariate_higher_order.c below TIMEOUT 300.005
multivariate_higher_order_unsafe.c below TIMEOUT 300.006
n_cubed_solution.c below EXCEPTION 109.175
n_cubed_solution_unsafe.c below EXCEPTION 0.024
n_log_n_solution.c below 9 FAIL1.364
n_log_n_solution_unsafe.c below 9 OKAY1.362
n_squared_two_base_case_even.c below 2 PASS0.553
n_squared_two_base_case_even_unsafe.c below 2 OKAY0.595
n_squared_two_base_case_odd.c below 2 PASS0.589
n_squared_two_base_case_odd_unsafe.c below 2 OKAY0.605
pascals_dynamic.c below 3 FAIL2.918
pascals_dynamic_unsafe.c below 3 OKAY2.983
pascals_iterative.c below 1 FAIL4.897
pascals_iterative_unsafe.c below 1 OKAY4.985
pascals_recursive.c below 8 FAIL5.243
pascals_recursive_unsafe.c below 8 OKAY5.27
squared_solution.c below 8 FAIL11.145
squared_solution_unsafe.c below 8 OKAY11.173
two_n_even.c below 2 PASS0.397
two_n_even_unsafe.c below 2 OKAY0.418
two_n_odd.c below 2 PASS0.415
two_n_odd_unsafe.c below 2 OKAY0.434
two_to_n_over_two_even.c below 7 FAIL1.029
two_to_n_over_two_even_unsafe.c below 7 OKAY1.037
two_to_n_over_two_odd.c below 7 FAIL1.013
two_to_n_over_two_odd_unsafe.c below 7 OKAY1.002
two_to_n_squared.c below 5 FAIL24.253
two_to_n_squared_unsafe.c below 5 OKAY24.081
two_to_two_to_n.c below 7 FAIL1.085
two_to_two_to_n_unsafe.c below 7 OKAY1.033
ICRA Assertions (True) = 5/21
ICRA Assertions (False) = 16/19
ICRA Time = 1618.738
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/exponential
adding_and_mult.c below 1 PASS0.348
adding_and_mult_unsafe.c below 1 OKAY0.366
binary_search_array_tree.c below 1 FAIL0.685
exp_add_linear.c below 1 PASS0.415
exp_add_linear_unsafe.c below 1 OKAY0.405
exp_add_loop_rec.c below 1 FAIL0.354
exp_add_loop_rec_unsafe.c below 1 OKAY0.352
exp_add_loop_variable.c below 1 PASS0.394
exp_add_loop_variable_unsafe.c below 1 OKAY0.41
exp_with_linear_inner_loop.c below 1 FAIL0.47
exp_with_linear_inner_loop_unsafe.c below 1 OKAY0.476
halving_log1.c below 1 FAIL0.483
linear_two_to_n.c below TIMEOUT 300.012
linear_two_to_n_unsafe.c below TIMEOUT 300.005
loop_five_to_n.c below 1 PASS0.391
loop_five_to_n_unsafe.c below 1 OKAY0.387
non_loop_five_to_n.c below TIMEOUT 300.031
non_loop_five_to_n_unsafe.c below TIMEOUT 300.03
power_log.c below 1 PASS0.485
power_log_modified.c below 1 PASS0.499
simple_exponential.c below 1 PASS0.389
simple_exponential_for.c below 1 PASS0.387
simple_exponential_for_unsafe.c below 1 OKAY0.387
simple_exponential_unsafe.c below 1 OKAY0.396
two_to_n_minus_n.c below 8 FAIL2.977
two_to_n_minus_n_loop.c below 8 FAIL4.7
two_to_n_minus_n_loop_unsafe.c below 8 OKAY4.691
two_to_n_minus_n_unsafe.c below 8 OKAY3.014
ICRA Assertions (True) = 8/16
ICRA Assertions (False) = 10/12
ICRA Time = 1223.939
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/frankenstein/HOLA
01.c below 3 PASS0.552
02.c below 3 FAIL0.693
03.c below 1 PASS0.44
04.c below 1 PASS0.34
05.c below 3 PASS0.995
06.c below 3 PASS7.574
07.c below 3 PASS0.52
08.c below 3 PASS1.117
09.c below 3 PASS0.622
10.c below 3 FAIL0.876
11.c below 1 PASS0.342
12.c below 3 PASS1.184
13.c below 3 PASS0.482
14.c below 3 PASS0.428
15.c below 1 PASS0.346
16.c below 1 PASS0.429
17.c below 1 PASS0.48
18.c below 1 PASS0.38
19.c below 1 PASS0.433
20.c below 3 FAIL0.6
21.c below 3 PASS0.516
22.c below 3 FAIL0.664
23.c below 1 PASS0.355
24.c below 1 PASS0.39
25.c below 3 FAIL1.345
26.c below 3 PASS114.094
27.c below 1 PASS0.427
28.c below 3 PASS0.468
29.c below EXCEPTION 0.398
30.c below 1 PASS0.353
31.c below 3 PASS0.806
32.c below 1 FAIL0.39
33.c below 3 PASS1.343
34.c below 1 FAIL0.372
35.c below 1 PASS0.331
36.c below 3 PASS2.273
37.c below 3 FAIL0.445
38.c below 1 FAIL0.385
39.c below 3 PASS0.408
40.c below 3 PASS0.633
41.c below 1 PASS0.395
42.c below EXCEPTION 0.384
43.c below 3 PASS0.44
44.c below 1 PASS0.35
45.c below 3 FAIL3.232
46.c below 3 FAIL1.749
ICRA Assertions (True) = 33/46
ICRA Assertions (False) = 0/0
ICRA Time = 151.779
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/frankenstein/relational
AGHKTW2017_bar.c below 1 PASS0.383
AGHKTW2017_foo.c below 1 PASS0.405
AGHKTW2017_loginSafe.c below 1 PASS0.8
AGHKTW2017_loopAndBranch_safe.c below 1 FAIL0.447
BCK2011_gauss.c below 1 PASS0.434
BCK2011_strength_reduction.c below 1 PASS0.394
BCK2011_strength_reduction_linear.c below 1 PASS0.449
fibonacci_information_flow.c below 1 PASS0.555
TA2005_fib2.c below 1 PASS0.538
TA2005_fib.c below 1 PASS0.45
ICRA Assertions (True) = 9/10
ICRA Assertions (False) = 0/0
ICRA Time = 4.855