[Version Information]
WALi-OpenNWA version: 088075c428c89531f84bc48ca70e4f182df9184b (2017-08-09 10:53:57 -0500) "the scripts used for POPL18 submission and fixed soundness errors for nightly run"
duet version: 7a637cd53ac9dd819b179b14263f4763715db4a5 (2017-08-21 16:13:10 -0400) "Merge remote-tracking branch 'origin/ark2' into Newton-ark2"
# Installed packages for 4.02.3+PIC:
apron              20160125  APRON numerical abstract domain library
base-bigarray          base  Bigarray library distributed with the OCaml compile
base-bytes             base  Bytes library distributed with the OCaml compiler
base-num               base  Num library distributed with the OCaml compiler
base-ocamlbuild        base  OCamlbuild binary and libraries distributed with th
base-threads           base  Threads library distributed with the OCaml compiler
base-unix              base  Unix library distributed with the OCaml compiler
batteries             2.7.0  a community-maintained standard library extension
camlidl                1.05  Stub code generator for OCaml
camlp4               4.02+7  Camlp4 is a system for writing extensible parsers f
cil                20150825  A front-end for the C programming language that fac
conf-gmp                  1  Virtual package relying on a GMP lib system install
conf-m4                   1  Virtual package relying on m4
conf-mathsat              1  Virtual package relying on a MathSAT system install
conf-mpfr                 1  Virtual package relying on library MPFR installatio
conf-perl                 1  Virtual package relying on perl
conf-python-2-7         1.0  Virtual package relying on Python-2.7 installation.
conf-which                1  Virtual package relying on which
cppo                  1.6.0  Equivalent of the C preprocessor for OCaml programs
cppo_ocamlbuild       1.6.0  ocamlbuild support for cppo, OCaml-friendly source 
deriving           20140904  Extension to OCaml for deriving functions from type
jbuilder         1.0+beta12  Fast, portable and opinionated build system
mathsat            20161206  MathSAT 5 SMT solver
menhir             20170712  LR(1) parser generator
mlgmpidl              1.2.4  OCaml interface to the GMP library
num                       0  The Num library for arbitrary-precision integer and
oasis                0.4.10  Tooling for building OCaml libraries and applicatio
ocamlbuild                0  Build system distributed with the OCaml compiler si
ocamlfind             1.7.3  A library manager for OCaml
ocamlgraph            1.8.7  A generic graph library for OCaml
ocamlify              0.0.1  Include files in OCaml code
ocamlmod              0.0.8  Generate OCaml modules from source files
OCRS               20170817  Recurrence solver based on operational calculus
optcomp                 1.6  Optional compilation with cpp-like directives
ounit                 2.0.0  Unit testing framework loosely based on HUnit. It i
ppx_deriving            4.1  Type-driven code generation for OCaml >=4.02
ppx_tools        5.0+4.02.0  Tools for authors of ppx rewriters and other syntac
result                  1.2  Compatibility Result module
Z3                 20161217  Z3 SMT solver

Test Name Output No. of Rounds Result Run Time
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/c4b
gcd.c below 1 FAIL0.383
kmp.c below 1 PASS1.079
qsort.c below 4 PASS0.914
speed_pldi09_fig1.c below 1 PASS0.507
speed_pldi09_fig4_2.c below 1 FAIL0.397
speed_pldi09_fig4_4.c below 1 PASS0.512
speed_pldi09_fig4_5.c below 1 PASS0.416
speed_pldi10_ex1.c below 1 PASS1.222
speed_pldi10_ex3.c below 1 PASS0.512
speed_pldi10_ex4.c below 1 PASS0.545
speed_popl10_fig2_1.c below 1 PASS0.485
speed_popl10_fig2_2.c below 1 FAIL0.379
speed_popl10_nested_multiple.c below 1 PASS0.467
speed_popl10_nested_single.c below 1 PASS0.424
speed_popl10_sequential_single.c below 1 PASS0.394
speed_popl10_simple_multiple.c below 1 PASS0.508
speed_popl10_simple_single_2.c below 1 PASS0.626
speed_popl10_simple_single.c below 1 PASS0.367
t07.c below 1 PASS0.435
t08.c below 1 PASS0.392
t09.c below 1 PASS0.398
t10.c below 1 PASS0.378
t11.c below 1 PASS0.489
t13.c below 1 FAIL0.423
t15.c below 1 PASS0.409
t16.c below 1 PASS0.411
t19.c below 1 PASS0.407
t20.c below 1 PASS0.376
t27.c below 1 PASS0.537
t28.c below 1 PASS0.463
t30.c below 1 FAIL0.416
t37.c below 2 PASS0.614
t39.c below 2 PASS0.541
t46.c below 1 PASS0.424
t47.c below 1 PASS0.511
ICRA Assertions (True) = 30/35
ICRA Assertions (False) = 0/0
ICRA Time = 17.761
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/misc-recursive
mult-rec.c below 2 PASS0.4
qsort_full.c below 4 PASS9.301
rec1-param_safe.c below 2 PASS0.399
rec1-param_unsafe.c below 2 OKAY0.391
rec1_safe.c below 2 PASS0.381
rec1_unsafe.c below 2 OKAY0.4
rec2-param_safe.c below 2 PASS0.376
rec2-param_unsafe.c below 2 OKAY0.385
rec2_safe.c below 2 PASS0.372
rec2_unsafe.c below 2 OKAY0.392
rec-test.c below 2 PASS0.368
sas03_bothbranches.c below 7 PASS0.789
sas03.c below 2 PASS0.778
simulated_lese_recursive.c below 2 PASS0.466
ICRA Assertions (True) = 10/10
ICRA Assertions (False) = 4/4
ICRA Time = 15.198
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/duet
count_up_down_safe.c below 1 PASS0.342
count_up_down_unsafe.c below 1 OKAY0.335
divide.c below 1 PASS0.347
factor_unsafe.c below 1 OKAY0.34
for_infinite_loop_1_safe.c below 1 PASS0.323
for_infinite_loop_2_safe.c below 1 PASS0.336
interproc.c below 1 PASS0.315
mult.c below 1 PASS0.337
pointer_arith.c below 1 PASS0.301
quotient.c below 3 PASS0.485
subtract.c below 1 PASS0.324
sum01_bug02_sum01_bug02_base.case_unsafe.c below 1 OKAY0.349
sum01_bug02_unsafe.c below 1 OKAY0.554
sum01_real_safe.c below 1 PASS0.34
sum01_safe.c below 1 PASS0.351
sum01_unsafe.c below 1 OKAY0.434
sum02_safe.c below 1 PASS0.362
sum03_safe.c below 1 PASS0.393
sum03_unsafe.c below 1 OKAY0.454
sum04_safe.c below 1 PASS0.35
sum04_unsafe.c below 1 OKAY0.443
terminator_02_safe.c below 1 PASS0.33
terminator_02_unsafe.c below 1 OKAY0.367
terminator_03_safe.c below 1 PASS0.322
terminator_03_unsafe.c below 1 OKAY0.346
token_ring01_safe.c below 4 FAIL141.945
token_ring01_unsafe.c below 4 OKAY237.512
toy_safe.c below EXCEPTION 172.546
trex01_safe.c below 1 PASS0.755
trex01_unsafe.c below 1 OKAY0.368
trex02_safe2.c below 3 PASS0.405
trex02_safe.c below 3 PASS0.405
trex02_unsafe.c below 3 OKAY0.413
trex03_safe.c below 1 PASS0.433
trex03_unsafe.c below 1 OKAY0.417
trex04_safe.c below 1 PASS0.349
while_infinite_loop_1_safe.c below 1 PASS0.308
while_infinite_loop_2_safe.c below 1 PASS0.356
while_infinite_loop_3_safe.c below 1 PASS0.374
ICRA Assertions (True) = 24/26
ICRA Assertions (False) = 13/13
ICRA Time = 565.766
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests
above_litmus.c below 3 PASS0.477
blogger_simplified1.c below 3 PASS1.126
divided_difference2.c below TIMEOUT 300.004
mult-proc.c below 3 PASS0.381
mult-proc-params.c below 3 PASS0.404
popall.c below 1 PASS0.68
simulated_scc.c below 1 PASS0.637
ICRA Assertions (True) = 6/7
ICRA Assertions (False) = 0/0
ICRA Time = 303.709
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/polynomial/assert
degree1_monomial.c below 1 PASS0.353
degree2_binomial.c below 1 PASS0.683
degree2_monomial.c below 1 PASS0.399
degree3_binomial.c below 1 FAIL2.103
degree3_monomial.c below 1 PASS0.454
degree4_binomial.c below 1 FAIL7.108
degree4_monomial.c below 1 PASS0.527
degree5_binomial.c below 1 TIMEOUT300.017
degree5_monomial.c below 1 PASS0.595
ICRA Assertions (True) = 6/9
ICRA Assertions (False) = 0/0
ICRA Time = 312.239
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/snlee/snlee_tests
cubic_with_square.c below 1 FAIL0.452
cubic_with_square_interproc.c below 2 FAIL0.583
cubic_with_square_nonlinear.c below 1 FAIL0.395
cubic_with_square_nonlinear_interproc.c below 2 FAIL0.428
cubic_with_square_nonlinear_unsafe.c below 1 OKAY0.388
cubic_with_square_unsafe.c below 1 OKAY0.464
multi-input.c below 1 FAIL0.488
multi-input_unsafe.c below 1 OKAY0.487
nondet_loop_bound.c below 1 FAIL0.363
nondet_loop_bound_quartic.c below 1 FAIL0.391
nondet_loop_bound_quartic_unsafe.c below 1 OKAY0.391
nondet_loop_bound_unsafe.c below 1 OKAY0.356
nonlinear_stratified.c below 1 TIMEOUT300.005
nonlinear_stratified_unsafe.c below 1 TIMEOUT300.004
quartic_with_cube.c below 1 FAIL0.605
quartic_with_cube_nonlinear.c below 1 FAIL0.408
quartic_with_cube_nonlinear_unsafe.c below 1 OKAY0.405
quartic_with_cube_unsafe.c below 1 OKAY0.503
quintic_with_quartic.c below 1 PASS1.031
quintic_with_quartic_nonlinear.c below 1 TIMEOUT300.006
quintic_with_quartic_nonlinear_unsafe.c below 1 OKAY0.551
quintic_with_quartic_unsafe.c below 1 OKAY1.049
ICRA Assertions (True) = 1/12
ICRA Assertions (False) = 9/10
ICRA Time = 909.753
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/FiniteDifferencing
degree2.c below 1 PASS0.691
degree2_FD_AllAux_AllAssm.c below 1 PASS107.272
degree2_FD_AllAux_FewAssm.c below 1 PASS6.319
degree2_FD_FewAux_FewAssm.c below 1 PASS1.038
degree2_FD_FewAux_FewAssm_NonLinAsrt.c below 1 PASS0.994
degree3.c below 1 PASS0.72
degree3_FD.c below 1 PASS0.938
degree4.c below 1 PASS0.45
ICRA Assertions (True) = 8/8
ICRA Assertions (False) = 0/0
ICRA Time = 118.422
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LESE
loop.c below 1 PASS0.444
loop_unsafe.c below 1 OKAY0.461
simulated_lese_parser.c below 1 PASS0.37
simulated_lese_sentinel.c below 1 PASS0.354
ICRA Assertions (True) = 3/3
ICRA Assertions (False) = 1/1
ICRA Time = 1.629
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LowerBound
lower_bound.c below 1 PASS0.364
ICRA Assertions (True) = 1/1
ICRA Assertions (False) = 0/0
ICRA Time = 0.364
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/STAC/LZ
lz77.c below TIMEOUT 300.005
ICRA Assertions (True) = 0/1
ICRA Assertions (False) = 0/0
ICRA Time = 300.005
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-acceleration
array_false-unreach-call1.c below 1 OKAY0.349
array_false-unreach-call2.c below 1 OKAY0.37
array_false-unreach-call3.c below 1 OKAY0.351
array_true-unreach-call1.c below 1 FAIL0.363
array_true-unreach-call2.c below 1 FAIL0.37
array_true-unreach-call3.c below 1 PASS0.354
array_true-unreach-call4.c below 1 FAIL0.347
const_false-unreach-call1.c below 1 OKAY0.376
const_true-unreach-call1.c below 1 PASS0.336
diamond_false-unreach-call1.c below 1 OKAY0.348
diamond_true-unreach-call1.c below 1 PASS0.348
diamond_true-unreach-call2.c below 1 PASS0.371
functions_false-unreach-call1.c below 3 OKAY0.407
functions_true-unreach-call1.c below 3 PASS0.397
multivar_false-unreach-call1.c below 1 OKAY0.343
multivar_true-unreach-call1.c below 1 PASS0.348
nested_false-unreach-call1.c below 1 OKAY0.378
nested_true-unreach-call1.c below 1 PASS0.371
overflow_true-unreach-call1.c below 1 PASS0.318
phases_false-unreach-call1.c below 1 OKAY0.407
phases_false-unreach-call2.c below 1 OKAY0.348
phases_true-unreach-call1.c below 1 PASS0.397
phases_true-unreach-call2.c below 1 PASS0.352
simple_false-unreach-call1.c below 1 OKAY0.32
simple_false-unreach-call2.c below 1 OKAY0.339
simple_false-unreach-call3.c below 1 OKAY0.335
simple_false-unreach-call4.c below 1 OKAY0.322
simple_true-unreach-call1.c below 1 PASS0.335
simple_true-unreach-call2.c below 1 PASS0.327
simple_true-unreach-call3.c below 1 PASS0.317
simple_true-unreach-call4.c below 1 PASS0.33
underapprox_false-unreach-call1.c below 1 OKAY0.354
underapprox_false-unreach-call2.c below 1 OKAY0.362
underapprox_true-unreach-call1.c below 1 FAIL0.345
underapprox_true-unreach-call2.c below 1 PASS0.35
ICRA Assertions (True) = 15/19
ICRA Assertions (False) = 16/16
ICRA Time = 12.385
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-invgen
apache-escape-absolute_true-unreach-call.c below 1 PASS0.871
apache-get-tag_true-unreach-call.c below 1 FAIL0.422
down_true-unreach-call.c below 1 PASS0.381
fragtest_simple_true-unreach-call.c below 1 PASS0.451
half_2_true-unreach-call.c below 1 PASS0.411
heapsort_true-unreach-call.c below 1 PASS116.002
id_build_true-unreach-call.c below 1 PASS0.351
id_trans_false-unreach-call.c below 1 OKAY0.338
id_trans_true-unreach-call.c below 1 PASS0.336
large_const_true-unreach-call.c below 1 PASS0.435
MADWiFi-encode_ie_ok_true-unreach-call.c below 1 PASS0.371
nested6_true-unreach-call.c below 1 FAIL0.487
nested9_true-unreach-call.c below 1 PASS0.545
nest-if3_true-unreach-call.c below 1 PASS0.493
NetBSD_loop_true-unreach-call.c below 1 PASS0.356
sendmail-close-angle_true-unreach-call.c below 1 FAIL0.396
seq_true-unreach-call.c below 1 PASS0.408
SpamAssassin-loop_true-unreach-call.c below 1 PASS1.196
string_concat-noarr_true-unreach-call.c below 1 PASS0.393
up_true-unreach-call.c below 1 PASS0.387
ICRA Assertions (True) = 16/19
ICRA Assertions (False) = 1/1
ICRA Time = 125.03
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-lit
afnp2014_true-unreach-call.c below 1 PASS0.364
bhmr2007_true-unreach-call.c below 1 PASS0.388
cggmp2005b_true-unreach-call.c below 1 PASS0.499
cggmp2005_true-unreach-call.c below 1 PASS0.34
cggmp2005_variant_true-unreach-call.c below 1 PASS0.357
css2003_true-unreach-call.c below 1 PASS0.767
ddlm2013_true-unreach-call.c below 1 PASS0.502
gcnr2008_false-unreach-call.c below 1 OKAY0.932
gj2007b_true-unreach-call.c below 1 FAIL0.379
gj2007_true-unreach-call.c below 1 PASS0.429
gr2006_true-unreach-call.c below 1 PASS0.419
gsv2008_true-unreach-call.c below 1 PASS0.35
hhk2008_true-unreach-call.c below 1 PASS0.345
jm2006_true-unreach-call.c below 1 PASS0.426
jm2006_variant_true-unreach-call.c below 1 PASS0.481
mcmillan2006_true-unreach-call.c below 1 FAIL0.374
ICRA Assertions (True) = 13/15
ICRA Assertions (False) = 1/1
ICRA Time = 7.352
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-new
count_by_1_true-unreach-call.c below 1 PASS0.331
count_by_1_variant_true-unreach-call.c below 1 PASS0.372
count_by_2_true-unreach-call.c below 1 PASS0.334
count_by_k_true-unreach-call.c below 1 PASS0.332
count_by_nondet_true-unreach-call.c below 1 PASS0.354
gauss_sum_true-unreach-call.c below 1 PASS0.364
half_true-unreach-call.c below 1 FAIL0.362
nested_true-unreach-call.c below 1 PASS0.411
ICRA Assertions (True) = 7/8
ICRA Assertions (False) = 0/0
ICRA Time = 2.86
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loops
array_false-unreach-call.c below 1 OKAY0.388
array_true-unreach-call.c below 1 FAIL0.406
bubble_sort_false-unreach-call.c below 4 OKAY71.302
bubble_sort_true-unreach-call.c below 1 PASS4.253
compact_false-unreach-call.c below 1 OKAY0.401
count_up_down_false-unreach-call_true-termination.c below 1 OKAY0.36
count_up_down_true-unreach-call_true-termination.c below 1 PASS0.351
eureka_01_false-unreach-call.c below 1 OKAY2.101
eureka_01_true-unreach-call.c below 1 FAIL1.442
eureka_05_true-unreach-call.c below 1 FAIL0.67
for_bounded_loop1_false-unreach-call_true-termination.c below 1 OKAY0.332
for_bounded_loop1_true-unreach-call_true-termination.c below 1 PASS0.356
for_infinite_loop_1_true-unreach-call_false-termination.c below 1 PASS0.326
for_infinite_loop_2_true-unreach-call_false-termination.c below 1 PASS0.327
heavy_false-unreach-call.c below 1 OKAY0.501
heavy_true-unreach-call.c below 1 PASS0.477
insertion_sort_false-unreach-call.c below 1 OKAY1.411
insertion_sort_true-unreach-call.c below 1 FAIL0.573
invert_string_false-unreach-call.c below 1 OKAY0.48
invert_string_true-unreach-call.c below 1 FAIL0.518
linear_sea.ch_true-unreach-call.c below 1 FAIL0.398
linear_search_false-unreach-call.c below 1 OKAY0.383
lu.cmp_true-unreach-call.c below 3 PASS25.096
ludcmp_false-unreach-call.c below 3 OKAY25.537
matrix_false-unreach-call_true-termination.c below 1 OKAY1.179
matrix_true-unreach-call_true-termination.c below 1 FAIL0.445
n.c11_true-unreach-call.c below 3 FAIL0.463
n.c24_false-unreach-call.c below 3 OKAY5.889
n.c40_true-unreach-call.c below 1 FAIL0.366
nec11_false-unreach-call.c below 1 OKAY0.36
nec20_false-unreach-call.c below 1 OKAY0.38
nec40_true-unreach-call.c below 1 FAIL0.365
string_false-unreach-call.c below 1 OKAY0.585
string_true-unreach-call.c below 1 FAIL0.582
sum01_bug02_false-unreach-call_true-termination.c below 1 OKAY0.543
sum01_bug02_sum01_bug02_base.case_false-unreach-call_true-termination.c below 1 OKAY0.34
sum01_false-unreach-call_true-termination.c below 1 OKAY0.452
sum01_true-unreach-call_true-termination.c below 1 PASS0.354
sum03_false-unreach-call_true-termination.c below 1 OKAY0.503
sum03_true-unreach-call_false-termination.c below 1 PASS0.43
sum04_false-unreach-call_true-termination.c below 1 OKAY0.444
sum04_true-unreach-call_true-termination.c below 1 PASS0.343
sum_array_false-unreach-call.c below 1 OKAY0.538
sum_array_true-unreach-call.c below 1 FAIL0.551
terminator_01_false-unreach-call_false-termination.c below 1 OKAY0.326
terminator_02_false-unreach-call_true-termination.c below 3 OKAY0.487
terminator_02_true-unreach-call_true-termination.c below 2 PASS0.35
terminator_03_false-unreach-call_true-termination.c below 1 OKAY0.334
terminator_03_true-unreach-call_true-termination.c below 1 PASS0.338
trex01_false-unreach-call_true-termination.c below 3 OKAY0.461
trex01_true-unreach-call.c below 3 PASS0.75
trex02_false-unreach-call_true-termination.c below 3 OKAY0.409
trex02_true-unreach-call_true-termination.c below 3 PASS0.379
trex03_false-unreach-call_true-termination.c below 3 OKAY0.689
trex03_true-unreach-call.c below 3 PASS0.679
trex04_true-unreach-call_false-termination.c below 1 PASS0.378
veris.c_NetBSD-libc__loop_true-unreach-call.c below 1 PASS0.359
veris.c_OpenSER__cases1_stripFullBoth_arr_true-unreach-call.c below 3 PASS7.238
veris.c_sendmail__tTflag_arr_one_loop_true-unreach-call.c below 1 PASS0.377
verisec_NetBSD-libc__loop_false-unreach-call.c below 1 OKAY0.352
verisec_OpenSER__cases1_stripFullBoth_arr_false-unreach-call.c below 3 OKAY7.008
vogal_false-unreach-call.c below 1 OKAY0.722
vogal_true-unreach-call.c below 1 FAIL0.722
while_infinite_loop_1_true-unreach-call_false-termination.c below 1 PASS0.299
while_infinite_loop_2_true-unreach-call_false-termination.c below 1 PASS0.298
while_infinite_loop_3_true-unreach-call_false-termination.c below 1 PASS0.308
while_infinite_loop_4_false-unreach-call_true-termination.c below 1 OKAY0.313
ICRA Assertions (True) = 22/35
ICRA Assertions (False) = 32/32
ICRA Time = 177.077
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive
Ackermann01_true-unreach-call.c below 7 PASS1.177
Ackermann02_false-unreach-call_false-termination.c below 7 OKAY1.132
Ackermann03_true-unreach-call.c below 7 FAIL1.209
Ackermann04_true-unreach-call.c below 7 FAIL1.2
Addition01_true-unreach-call_true-termination.c below 2 PASS0.588
Addition02_false-unreach-call_false-termination.c below 2 OKAY0.588
Addition03_false-no-overflow.c below 2 PASS0.578
Addition03_true-unreach-call.c below 2 PASS0.586
BallRajamani-SPIN2000-Fig1_false-unreach-call.c below 2 OKAY0.495
EvenOdd01_true-unreach-call_true-termination.c below 2 PASS0.424
EvenOdd03_false-unreach-call_false-termination.c below 2 OKAY0.442
Fibonacci01_true-unreach-call.c below TIMEOUT 300.004
Fibonacci02_true-unreach-call_true-termination.c below TIMEOUT 300.006
Fibonacci03_true-unreach-call_true-termination.c below TIMEOUT 300.007
Fibonacci04_false-unreach-call_true-termination.c below TIMEOUT 300.004
Fibonacci05_false-unreach-call_true-termination.c below TIMEOUT 300.006
gcd01_true-unreach-call_true-termination.c below 2 PASS0.586
gcd02_true-unreach-call.c below 2 FAIL1.108
McCarthy91_false-unreach-call_false-termination.c below 7 OKAY0.944
McCarthy91_true-unreach-call.c below 7 FAIL0.928
MultCommutative_true-unreach-call_true-termination.c below 2 FAIL0.57
Primes_true-unreach-call.c below 3 FAIL1.51
recHanoi01_true-unreach-call_true-termination.c below 7 FAIL2.663
recHanoi02_true-unreach-call_true-termination.c below 2 FAIL0.4
recHanoi03_true-unreach-call_true-termination.c below 2 FAIL0.425
ICRA Assertions (True) = 6/18
ICRA Assertions (False) = 5/7
ICRA Time = 1517.58
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive-simple
afterrec_2calls_false-unreach-call.c below 2 OKAY0.437
afterrec_2calls_true-unreach-call.c below 2 PASS0.416
afterrec_false-unreach-call.c below 2 OKAY0.374
afterrec_true-unreach-call.c below 2 PASS0.369
fibo_10_false-unreach-call.c below TIMEOUT 300.004
fibo_10_true-unreach-call.c below TIMEOUT 300.004
fibo_15_false-unreach-call.c below TIMEOUT 300.006
fibo_15_true-unreach-call.c below TIMEOUT 300.004
fibo_20_false-unreach-call.c below TIMEOUT 300.007
fibo_20_true-unreach-call.c below TIMEOUT 300.007
fibo_25_false-unreach-call.c below TIMEOUT 300.004
fibo_25_true-unreach-call.c below TIMEOUT 300.006
fibo_2calls_10_false-unreach-call.c below TIMEOUT 300.019
fibo_2calls_10_true-unreach-call.c below TIMEOUT 300.014
fibo_2calls_15_false-unreach-call.c below TIMEOUT 300.022
fibo_2calls_15_true-unreach-call.c below TIMEOUT 300.023
fibo_2calls_20_false-unreach-call.c below TIMEOUT 300.007
fibo_2calls_20_true-unreach-call.c below TIMEOUT 300.022
fibo_2calls_25_false-unreach-call.c below TIMEOUT 300.022
fibo_2calls_25_true-unreach-call.c below TIMEOUT 300.015
fibo_2calls_2_false-unreach-call.c below TIMEOUT 300.013
fibo_2calls_2_true-unreach-call.c below TIMEOUT 300.022
fibo_2calls_4_false-unreach-call.c below TIMEOUT 300.009
fibo_2calls_4_true-unreach-call.c below TIMEOUT 300.015
fibo_2calls_5_false-unreach-call.c below TIMEOUT 300.019
fibo_2calls_5_true-unreach-call.c below TIMEOUT 300.017
fibo_2calls_6_false-unreach-call.c below TIMEOUT 300.016
fibo_2calls_6_true-unreach-call.c below TIMEOUT 300.023
fibo_2calls_8_false-unreach-call.c below TIMEOUT 300.013
fibo_2calls_8_true-unreach-call.c below TIMEOUT 300.013
fibo_5_false-unreach-call.c below TIMEOUT 300.004
fibo_5_true-unreach-call.c below TIMEOUT 300.006
fibo_7_false-unreach-call.c below TIMEOUT 300.004
fibo_7_true-unreach-call.c below TIMEOUT 300.006
id2_b2_o3_true-unreach-call.c below 2 PASS0.696
id2_b3_o2_false-unreach-call.c below 2 OKAY0.707
id2_b3_o5_true-unreach-call.c below 2 PASS0.688
id2_b5_o10_true-unreach-call.c below 2 PASS0.684
id2_i5_o5_false-unreach-call.c below 2 OKAY0.431
id2_i5_o5_true-unreach-call.c below 2 PASS0.423
id_b2_o3_true-unreach-call.c below 2 PASS0.581
id_b3_o2_false-unreach-call.c below 2 OKAY0.576
id_b3_o5_true-unreach-call.c below 2 PASS0.612
id_b5_o10_true-unreach-call.c below 2 PASS0.576
id_i10_o10_false-unreach-call.c below 2 OKAY0.384
id_i10_o10_true-unreach-call.c below 2 PASS0.392
id_i15_o15_false-unreach-call.c below 2 OKAY0.375
id_i15_o15_true-unreach-call.c below 2 PASS0.384
id_i20_o20_false-unreach-call.c below 2 OKAY0.404
id_i20_o20_true-unreach-call.c below 2 PASS0.385
id_i25_o25_false-unreach-call.c below 2 OKAY0.394
id_i25_o25_true-unreach-call.c below 2 PASS0.39
id_i5_o5_false-unreach-call.c below 2 OKAY0.378
id_i5_o5_true-unreach-call.c below 2 PASS0.375
id_o1000_false-unreach-call.c below 2 OKAY0.383
id_o100_false-unreach-call.c below 2 OKAY0.389
id_o10_false-unreach-call.c below 2 OKAY0.393
id_o200_false-unreach-call.c below 2 OKAY0.38
id_o20_false-unreach-call.c below 2 OKAY0.399
id_o3_false-unreach-call.c below 2 OKAY0.389
sum_10x0_false-unreach-call.c below 2 OKAY0.415
sum_10x0_true-unreach-call.c below 2 PASS0.439
sum_15x0_false-unreach-call.c below 2 OKAY0.425
sum_15x0_true-unreach-call.c below 2 PASS0.419
sum_20x0_false-unreach-call.c below 2 OKAY0.431
sum_20x0_true-unreach-call.c below 2 PASS0.438
sum_25x0_false-unreach-call.c below 2 OKAY0.432
sum_25x0_true-unreach-call.c below 2 PASS0.406
sum_2x3_false-unreach-call.c below 2 OKAY0.417
sum_2x3_true-unreach-call.c below 2 PASS0.447
sum_non_eq_false-unreach-call.c below 2 OKAY0.447
sum_non_eq_true-unreach-call.c below 2 PASS0.436
sum_non_false-unreach-call.c below 2 OKAY0.424
sum_non_true-unreach-call.c below 2 PASS0.402
ICRA Assertions (True) = 21/36
ICRA Assertions (False) = 23/38
ICRA Time = 9020.108
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-lit
rec-afnp2014_true-unreach-call.c below 2 PASS0.42
rec-bhmr2007_true-unreach-call.c below 2 PASS0.423
rec-cggmp2005b_true-unreach-call.c below 3 PASS0.671
rec-cggmp2005_true-unreach-call.c below 2 PASS0.386
rec-cggmp2005_variant_true-unreach-call.c below 2 PASS0.427
rec-css2003_true-unreach-call.c below 2 PASS0.952
rec-ddlm2013_true-unreach-call.c below TIMEOUT 300.004
rec-gcnr2008_false-unreach-call.c below 2 OKAY0.821
rec-gj2007b_true-unreach-call.c below 2 FAIL0.393
rec-gj2007_true-unreach-call.c below 2 FAIL0.441
rec-gr2006_true-unreach-call.c below 2 FAIL0.482
rec-gsv2008_true-unreach-call.c below 2 PASS0.398
rec-hhk2008_true-unreach-call.c below 2 PASS0.404
rec-jm2006_true-unreach-call.c below 2 PASS0.457
rec-jm2006_variant_true-unreach-call.c below 2 PASS0.515
rec-mcmillan2006_true-unreach-call.c below 2 FAIL0.424
ICRA Assertions (True) = 10/15
ICRA Assertions (False) = 1/1
ICRA Time = 307.618
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/rec-sv-benchmarks/rec-loop-new
rec-count_by_1_true-unreach-call.c below 2 PASS0.358
rec-count_by_1_variant_true-unreach-call.c below 2 PASS0.4
rec-count_by_2_true-unreach-call.c below 2 PASS0.367
rec-count_by_k_true-unreach-call.c below 2 PASS0.398
rec-count_by_nondet_true-unreach-call.c below 2 FAIL0.389
rec-gauss_sum_true-unreach-call.c below 2 PASS0.431
rec-half_true-unreach-call.c below 2 FAIL0.416
rec-nested_true-unreach-call.c below 3 FAIL0.553
ICRA Assertions (True) = 5/8
ICRA Assertions (False) = 0/0
ICRA Time = 3.312
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/recurrences
cubic_polynomial.c below 2 PASS0.541
cubic_polynomial_unsafe.c below 2 OKAY0.531
edit_distance_bottom_up.c below 3 FAIL165.491
edit_distance_top_down.c below 3 FAIL4.111
log_log_n_solution.c below 3 FAIL0.447
log_log_n_solution_unsafe.c below 3 OKAY0.429
log_n_solution.c below 2 FAIL0.473
log_n_solution_unsafe.c below 2 OKAY0.466
multivariate_1.c below TIMEOUT 300.006
multivariate_1_unsafe.c below TIMEOUT 300.005
multivariate_higher_order.c below 7 FAIL2.527
multivariate_higher_order_unsafe.c below 7 OKAY2.482
n_cubed_solution.c below EXCEPTION 74.767
n_cubed_solution_unsafe.c below EXCEPTION 0.026
n_log_n_solution.c below 8 FAIL1.148
n_log_n_solution_unsafe.c below 8 OKAY1.152
n_squared_two_base_case_even.c below 2 PASS0.557
n_squared_two_base_case_even_unsafe.c below 2 OKAY0.568
n_squared_two_base_case_odd.c below 2 PASS0.575
n_squared_two_base_case_odd_unsafe.c below 2 OKAY0.573
pascals_dynamic.c below 3 FAIL2.239
pascals_dynamic_unsafe.c below 3 OKAY2.33
pascals_iterative.c below 1 FAIL4.301
pascals_iterative_unsafe.c below 1 OKAY4.362
pascals_recursive.c below 9 FAIL3.483
pascals_recursive_unsafe.c below 9 OKAY3.425
squared_solution.c below 8 FAIL2.662
squared_solution_unsafe.c below 8 OKAY2.752
two_n_even.c below 2 PASS0.422
two_n_even_unsafe.c below 2 OKAY0.421
two_n_odd.c below 2 PASS0.404
two_n_odd_unsafe.c below 2 OKAY0.422
two_to_n_over_two_even.c below 7 FAIL1.077
two_to_n_over_two_even_unsafe.c below 7 OKAY1.071
two_to_n_over_two_odd.c below 7 FAIL1.125
two_to_n_over_two_odd_unsafe.c below 7 OKAY1.103
two_to_n_squared.c below 5 FAIL16.897
two_to_n_squared_unsafe.c below 5 OKAY16.393
two_to_two_to_n.c below 7 FAIL1.027
two_to_two_to_n_unsafe.c below 7 OKAY0.996
ICRA Assertions (True) = 5/21
ICRA Assertions (False) = 17/19
ICRA Time = 923.787
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/exponential
adding_and_mult.c below 1 PASS0.372
adding_and_mult_unsafe.c below 1 OKAY0.362
binary_search_array_tree.c below 1 FAIL0.633
exp_add_linear.c below 1 PASS0.41
exp_add_linear_unsafe.c below 1 OKAY0.441
exp_add_loop_rec.c below 1 FAIL0.358
exp_add_loop_rec_unsafe.c below 1 OKAY0.374
exp_add_loop_variable.c below 1 PASS0.432
exp_add_loop_variable_unsafe.c below 1 OKAY0.425
exp_with_linear_inner_loop.c below 1 FAIL0.486
exp_with_linear_inner_loop_unsafe.c below 1 OKAY0.478
halving_log1.c below 1 FAIL0.498
linear_two_to_n.c below 7 FAIL20.612
linear_two_to_n_unsafe.c below 7 OKAY20.552
loop_five_to_n.c below 1 PASS0.371
loop_five_to_n_unsafe.c below 1 OKAY0.387
non_loop_five_to_n.c below 7 FAIL49.55
non_loop_five_to_n_unsafe.c below 7 OKAY49.672
power_log.c below 1 PASS0.511
power_log_modified.c below 1 PASS0.496
simple_exponential.c below 1 PASS0.37
simple_exponential_for.c below 1 PASS0.393
simple_exponential_for_unsafe.c below 1 OKAY0.393
simple_exponential_unsafe.c below 1 OKAY0.396
two_to_n_minus_n.c below 7 FAIL2.646
two_to_n_minus_n_loop.c below TIMEOUT 300.026
two_to_n_minus_n_loop_unsafe.c below TIMEOUT 300.025
two_to_n_minus_n_unsafe.c below 7 OKAY2.515
ICRA Assertions (True) = 8/16
ICRA Assertions (False) = 11/12
ICRA Time = 754.184
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/frankenstein/HOLA
01.c below 3 PASS0.536
02.c below 3 FAIL0.71
03.c below 1 PASS0.411
04.c below 1 PASS0.35
05.c below 3 PASS0.97
06.c below 3 FAIL7.346
07.c below 3 PASS0.538
08.c below 3 PASS1.115
09.c below 3 PASS0.647
10.c below 3 FAIL0.839
11.c below 1 PASS0.355
12.c below 3 PASS1.17
13.c below 3 PASS0.489
14.c below 3 PASS0.432
15.c below 1 PASS0.357
16.c below 1 PASS0.422
17.c below 1 PASS0.392
18.c below 1 PASS0.417
19.c below 1 PASS0.426
20.c below 3 FAIL0.592
21.c below 3 PASS0.5
22.c below 3 FAIL0.67
23.c below 1 PASS0.37
24.c below 1 PASS0.404
25.c below 3 FAIL1.197
26.c below TIMEOUT 300.004
27.c below 1 PASS0.417
28.c below 3 PASS0.493
29.c below 3 PASS0.837
30.c below 1 PASS0.368
31.c below 3 PASS0.825
32.c below 1 FAIL0.37
33.c below 3 PASS1.102
34.c below 1 FAIL0.385
35.c below 1 PASS0.331
36.c below 3 PASS2.268
37.c below 3 FAIL0.478
38.c below 1 FAIL0.373
39.c below 3 PASS0.418
40.c below 3 PASS0.645
41.c below 1 PASS0.387
42.c below 3 PASS0.764
43.c below 3 PASS0.458
44.c below 1 PASS0.35
45.c below 3 FAIL2.16
46.c below 3 FAIL1.3
ICRA Assertions (True) = 33/46
ICRA Assertions (False) = 0/0
ICRA Time = 336.388
/bat0/stac/Code/Ark2-Sandbox/WALi-OpenNWA/Examples/cprover/tests/frankenstein/relational
AGHKTW2017_bar.c below 1 PASS0.397
AGHKTW2017_foo.c below 1 PASS0.392
AGHKTW2017_loginSafe.c below 1 PASS0.814
AGHKTW2017_loopAndBranch_safe.c below 1 FAIL0.453
BCK2011_gauss.c below 1 PASS0.418
BCK2011_strength_reduction.c below 1 PASS0.398
BCK2011_strength_reduction_linear.c below 1 PASS0.414
fibonacci_information_flow.c below 1 PASS0.553
TA2005_fib2.c below 1 PASS0.573
TA2005_fib.c below 1 PASS0.476
ICRA Assertions (True) = 9/10
ICRA Assertions (False) = 0/0
ICRA Time = 4.888