Most recent versions:
WALi-OpenNWA version: c50415ec4c1bbe6ff06df2911e4b3deab9b59da9 (2016-12-14 13:13:36 -0600)
duet version: 957fb1dbe51ebae662efb6e7ddd8c39a0cc2b7ce (2017-01-06 18:24:03 -0500)
Test Name Output Duet Output No. of Rounds Result Run Time (Prev.) Duet Result
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/c4b
gcd.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
kmp.c below duet EXCEPTION
0.152
above EXCEPTION
0.152
qsort.c below duet EXCEPTION
0.15
above EXCEPTION
0.148
speed_pldi09_fig1.c below duet EXCEPTION
0.153
above EXCEPTION
0.148
speed_pldi09_fig4_2.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
speed_pldi09_fig4_4.c below duet EXCEPTION
0.149
above EXCEPTION
0.152
speed_pldi09_fig4_5.c below duet EXCEPTION
0.154
above EXCEPTION
0.15
speed_pldi10_ex1.c below duet EXCEPTION
0.15
above EXCEPTION
0.148
speed_pldi10_ex3.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
speed_pldi10_ex4.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
speed_popl10_fig2_1.c below duet EXCEPTION
0.148
above EXCEPTION
0.146
speed_popl10_fig2_2.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
speed_popl10_nested_multiple.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
speed_popl10_nested_single.c below duet EXCEPTION
0.149
above EXCEPTION
0.151
speed_popl10_sequential_single.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
speed_popl10_simple_multiple.c below duet EXCEPTION
0.147 (0.168)
above EXCEPTION
0.151
speed_popl10_simple_single_2.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
speed_popl10_simple_single.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
t07.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
t08.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
t09.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
t10.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
t11.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
t13.c below duet EXCEPTION
0.148 (0.17)
above EXCEPTION
0.151
t15.c below duet EXCEPTION
0.147
above EXCEPTION
0.146
t16.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
t19.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
t20.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
t27.c below duet EXCEPTION
0.148
above EXCEPTION
0.148 (0.211)
t28.c below duet EXCEPTION
0.148
above EXCEPTION
0.158
t30.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
t37.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
t39.c below duet EXCEPTION
0.149
above EXCEPTION
0.151
t46.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
t47.c below duet EXCEPTION
0.152
above EXCEPTION
0.148
Total Below Time = 5.221 (was 5.243)
Above Time = 5.22 (was 5.312)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/misc-recursive
mult-rec.c below duet EXCEPTION
0.149
above EXCEPTION
0.156
qsort_full.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
qsort_full_TEST.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
rec1-param_safe.c below duet EXCEPTION
0.151
above EXCEPTION
0.152
rec1-param_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
rec1_safe.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
rec1_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.153
rec2-param_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
rec2-param_unsafe.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
rec2_safe.c below duet EXCEPTION
0.148
above EXCEPTION
0.152
rec2_unsafe.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
rec-test.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
sas03_bothbranches.c below duet EXCEPTION
0.151
above EXCEPTION
0.154
sas03.c below duet EXCEPTION
0.155
above EXCEPTION
0.148
simulated_lese_recursive.c below duet EXCEPTION
0.147
above EXCEPTION
0.146
Total Below Time = 2.235 (was 2.22)
Above Time = 2.242 (was 2.236)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/duet
count_up_down_safe.c below duet EXCEPTION
0.15
above EXCEPTION
0.157
count_up_down_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
divide.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
factor_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
for_infinite_loop_1_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
for_infinite_loop_2_safe.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
interproc.c below duet EXCEPTION
0.148
above EXCEPTION
0.156
mult.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
pointer_arith.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
quotient.c below duet EXCEPTION
0.148
above EXCEPTION
0.156
subtract.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
sum01_bug02_sum01_bug02_base.case_unsafe.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
sum01_bug02_unsafe.c below duet EXCEPTION
0.151
above EXCEPTION
0.223 (0.147)
sum01_real_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
sum01_safe.c below duet EXCEPTION
0.152
above EXCEPTION
0.148
sum01_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
sum02_safe.c below duet EXCEPTION
0.15
above EXCEPTION
0.151
sum03_safe.c below duet EXCEPTION
0.15
above EXCEPTION
0.151
sum03_unsafe.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
sum04_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
sum04_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
terminator_02_safe.c below duet EXCEPTION
0.15
above EXCEPTION
0.151
terminator_02_unsafe.c below duet EXCEPTION
0.146
above EXCEPTION
0.146
terminator_03_safe.c below duet EXCEPTION
0.15
above EXCEPTION
0.148
terminator_03_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
token_ring01_safe.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
token_ring01_unsafe.c below duet EXCEPTION
0.147
above EXCEPTION
0.153
toy_safe.c below duet EXCEPTION
0.156
above EXCEPTION
0.152
trex01_safe.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
trex01_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
trex02_safe2.c below duet EXCEPTION
0.155
above EXCEPTION
0.15
trex02_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
trex02_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
trex03_safe.c below duet EXCEPTION
0.155
above EXCEPTION
0.149
trex03_unsafe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
trex04_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
while_infinite_loop_1_safe.c below duet EXCEPTION
0.154
above EXCEPTION
0.148
while_infinite_loop_2_safe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
while_infinite_loop_3_safe.c below duet EXCEPTION
0.148
above EXCEPTION
0.153
Total Below Time = 5.812 (was 5.807)
Above Time = 5.905 (was 5.843)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests
above_litmus.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
blogger_simplified1.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
divided_difference2.c below duet EXCEPTION
0.15
above EXCEPTION
0.15
mult-proc.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
mult-proc-params.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
popall.c below duet EXCEPTION
0.151
above EXCEPTION
0.15
simulated_scc.c below duet EXCEPTION
0.153
above EXCEPTION
0.146
Total Below Time = 1.055 (was 1.04)
Above Time = 1.035 (was 1.04)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/STAC/polynomial/assert
degree1_monomial.c below duet EXCEPTION
0.157
above EXCEPTION
0.149
degree2_binomial.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
degree2_monomial.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
degree3_binomial.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
degree3_monomial.c below duet EXCEPTION
0.151
above EXCEPTION
0.15
degree4_binomial.c below duet EXCEPTION
0.157
above EXCEPTION
0.147
degree4_monomial.c below duet EXCEPTION
0.154
above EXCEPTION
0.148
degree5_binomial.c below duet EXCEPTION
0.158
above EXCEPTION
0.147
degree5_monomial.c below duet EXCEPTION
0.159
above EXCEPTION
0.151
Total Below Time = 1.387 (was 1.352)
Above Time = 1.333 (was 1.356)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/snlee/snlee_tests
cubic_with_square.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
cubic_with_square_interproc.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
cubic_with_square_nonlinear.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
cubic_with_square_nonlinear_interproc.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
cubic_with_square_nonlinear_unsafe.c below duet EXCEPTION
0.147
above EXCEPTION
0.16
cubic_with_square_unsafe.c below duet EXCEPTION
0.167 (0.151)
above EXCEPTION
0.15
multi-input.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
multi-input_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
nondet_loop_bound.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
nondet_loop_bound_quartic.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
nondet_loop_bound_quartic_unsafe.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
nondet_loop_bound_unsafe.c below duet EXCEPTION
0.156
above EXCEPTION
0.147
nonlinear_stratified.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
nonlinear_stratified_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
quartic_with_cube.c below duet EXCEPTION
0.153
above EXCEPTION
0.149
quartic_with_cube_nonlinear.c below duet EXCEPTION
0.15
above EXCEPTION
0.149
quartic_with_cube_nonlinear_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.151 (0.218)
quartic_with_cube_unsafe.c below duet EXCEPTION
0.151
above EXCEPTION
0.146
quintic_with_quartic.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
quintic_with_quartic_nonlinear.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
quintic_with_quartic_nonlinear_unsafe.c below duet EXCEPTION
0.153
above EXCEPTION
0.148
quintic_with_quartic_unsafe.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
Total Below Time = 3.301 (was 3.281)
Above Time = 3.273 (was 3.36)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/STAC/FiniteDifferencing
degree2.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
degree2_FD_AllAux_AllAssm.c below duet EXCEPTION
0.155
above EXCEPTION
0.147
degree2_FD_AllAux_FewAssm.c below duet EXCEPTION
0.151
above EXCEPTION
0.153
degree2_FD_FewAux_FewAssm.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
degree2_FD_FewAux_FewAssm_NonLinAsrt.c below duet EXCEPTION
0.15
above EXCEPTION
0.15
degree3.c below duet EXCEPTION
0.146
above EXCEPTION
0.15
degree3_FD.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
degree4.c below duet EXCEPTION
0.155
above EXCEPTION
0.149
Total Below Time = 1.198 (was 1.208)
Above Time = 1.194 (was 1.184)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/STAC/LESE
loop.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
loop_unsafe.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
simulated_lese_parser.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
simulated_lese_sentinel.c below duet EXCEPTION
0.148
above EXCEPTION
0.146
Total Below Time = 0.595 (was 0.596)
Above Time = 0.589 (was 0.597)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/STAC/LowerBound
lower_bound.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
Total Below Time = 0.146 (was 0.155)
Above Time = 0.148 (was 0.147)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/STAC/LZ
lz77.c below duet EXCEPTION
0.156
above EXCEPTION
0.147
Total Below Time = 0.156 (was 0.148)
Above Time = 0.147 (was 0.147)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-acceleration
array_false-unreach-call1.c below duet EXCEPTION
0.146
above EXCEPTION
0.149
array_false-unreach-call2.c below duet EXCEPTION
0.147
above EXCEPTION
0.15
array_false-unreach-call3.c below duet EXCEPTION
0.152
above EXCEPTION
0.149
array_true-unreach-call1.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
array_true-unreach-call2.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
array_true-unreach-call3.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
array_true-unreach-call4.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
const_false-unreach-call1.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
const_true-unreach-call1.c below duet EXCEPTION
0.154
above EXCEPTION
0.149
diamond_false-unreach-call1.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
diamond_true-unreach-call1.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
diamond_true-unreach-call2.c below duet EXCEPTION
0.153
above EXCEPTION
0.146
functions_false-unreach-call1.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
functions_true-unreach-call1.c below duet EXCEPTION
0.146
above EXCEPTION
0.154
multivar_false-unreach-call1.c below duet EXCEPTION
0.155
above EXCEPTION
0.147
multivar_true-unreach-call1.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
nested_false-unreach-call1.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
nested_true-unreach-call1.c below duet EXCEPTION
0.221 (0.147)
above EXCEPTION
0.147
overflow_true-unreach-call1.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
phases_false-unreach-call1.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
phases_false-unreach-call2.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
phases_true-unreach-call1.c below duet EXCEPTION
0.146
above EXCEPTION
0.151
phases_true-unreach-call2.c below duet EXCEPTION
0.147
above EXCEPTION
0.154
simple_false-unreach-call1.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
simple_false-unreach-call2.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
simple_false-unreach-call3.c below duet EXCEPTION
0.149
above EXCEPTION
0.153
simple_false-unreach-call4.c below duet EXCEPTION
0.159
above EXCEPTION
0.16
simple_true-unreach-call1.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
simple_true-unreach-call2.c below duet EXCEPTION
0.148
above EXCEPTION
0.154
simple_true-unreach-call3.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
simple_true-unreach-call4.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
underapprox_false-unreach-call1.c below duet EXCEPTION
0.147
above EXCEPTION
0.156
underapprox_false-unreach-call2.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
underapprox_true-unreach-call1.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
underapprox_true-unreach-call2.c below duet EXCEPTION
0.151 (0.292)
above EXCEPTION
0.31 (0.156)
Total Below Time = 5.285 (was 5.394)
Above Time = 5.388 (was 5.215)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-invgen
apache-escape-absolute_true-unreach-call.c below duet EXCEPTION
0.166
above EXCEPTION
0.146
apache-get-tag_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.149
down_true-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.147
fragtest_simple_true-unreach-call.c below duet EXCEPTION
0.156
above EXCEPTION
0.147
half_2_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
heapsort_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
id_build_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.146
id_trans_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
large_const_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.151
MADWiFi-encode_ie_ok_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
nested6_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
nested9_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.146
nest-if3_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
NetBSD_loop_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.152
sendmail-close-angle_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.148
seq_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.146
SpamAssassin-loop_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
string_concat-noarr_true-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.151
up_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
Total Below Time = 2.871 (was 2.824)
Above Time = 2.812 (was 2.85)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-lit
afnp2014_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
bhmr2007_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.15
cggmp2005b_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.153
cggmp2005_true-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
cggmp2005_variant_true-unreach-call.c below duet EXCEPTION
0.153
above EXCEPTION
0.147
css2003_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
ddlm2013_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
gcnr2008_false-unreach-call.c below duet EXCEPTION
0.156
above EXCEPTION
0.15
gj2007b_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
gj2007_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.146
gr2006_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.146
gsv2008_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
hhk2008_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
jm2006_true-unreach-call.c below duet EXCEPTION
0.158
above EXCEPTION
0.147
jm2006_variant_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
mcmillan2006_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
Total Below Time = 2.397 (was 2.411)
Above Time = 2.372 (was 2.407)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loop-new
count_by_1_true-unreach-call.c below duet EXCEPTION
0.156
above EXCEPTION
0.147
count_by_1_variant_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.159
count_by_2_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
count_by_k_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.146
count_by_nondet_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.15
gauss_sum_true-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.147 (0.209)
half_true-unreach-call.c below duet EXCEPTION
0.155
above EXCEPTION
0.146
nested_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
Total Below Time = 1.211 (was 1.209)
Above Time = 1.192 (was 1.25)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/loops
array_false-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
array_true-unreach-call.c below duet EXCEPTION
0.153
above EXCEPTION
0.147
bubble_sort_false-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.149
bubble_sort_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.154
compact_false-unreach-call.c below duet EXCEPTION
0.155
above EXCEPTION
0.146
count_up_down_false-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
count_up_down_true-unreach-call_true-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
eureka_01_false-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.146
eureka_01_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.15
eureka_05_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
for_bounded_loop1_false-unreach-call_true-termination.c below duet EXCEPTION
0.151
above EXCEPTION
0.146
for_infinite_loop_1_true-unreach-call_false-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
for_infinite_loop_2_true-unreach-call_false-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
heavy_false-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.148
heavy_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
insertion_sort_false-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.149
insertion_sort_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.15
invert_string_false-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.149
invert_string_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
linear_sea.ch_true-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.146
linear_search_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.151
lu.cmp_true-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
ludcmp_false-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.148
matrix_false-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
matrix_true-unreach-call_true-termination.c below duet EXCEPTION
0.146
above EXCEPTION
0.15
n.c11_true-unreach-call.c below duet EXCEPTION
0.159
above EXCEPTION
0.147
n.c24_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
n.c40_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
nec11_false-unreach-call.c below duet EXCEPTION
0.162 (0.147)
above EXCEPTION
0.146
nec20_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
nec40_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
string_false-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.147
string_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
sum01_bug02_false-unreach-call_true-termination.c below duet EXCEPTION
0.15
above EXCEPTION
0.157
sum01_bug02_sum01_bug02_base.case_false-unreach-call_true-termination.c below duet EXCEPTION
0.221 (0.148)
above EXCEPTION
0.146
sum01_false-unreach-call_true-termination.c below duet EXCEPTION
0.15
above EXCEPTION
0.149
sum01_true-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
sum03_false-unreach-call_true-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
sum03_true-unreach-call_false-termination.c below duet EXCEPTION
0.16
above EXCEPTION
0.146
sum04_false-unreach-call_true-termination.c below duet EXCEPTION
0.155
above EXCEPTION
0.161
sum04_true-unreach-call_true-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
sum_array_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
sum_array_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.152
terminator_01_false-unreach-call_false-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
terminator_02_false-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
terminator_02_true-unreach-call_true-termination.c below duet EXCEPTION
0.153
above EXCEPTION
0.157
terminator_03_false-unreach-call_true-termination.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
terminator_03_true-unreach-call_true-termination.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
trex01_false-unreach-call_true-termination.c below duet EXCEPTION
0.15
above EXCEPTION
0.158
trex01_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
trex02_false-unreach-call_true-termination.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
trex02_true-unreach-call_true-termination.c below duet EXCEPTION
0.146
above EXCEPTION
0.152
trex03_false-unreach-call_true-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
trex03_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.149
trex04_true-unreach-call_false-termination.c below duet EXCEPTION
0.156
above EXCEPTION
0.159
veris.c_NetBSD-libc__loop_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
veris.c_OpenSER__cases1_stripFullBoth_arr_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.146
veris.c_sendmail__tTflag_arr_one_loop_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
verisec_NetBSD-libc__loop_false-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.147
verisec_OpenSER__cases1_stripFullBoth_arr_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
vogal_false-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.152
vogal_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
while_infinite_loop_1_true-unreach-call_false-termination.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
while_infinite_loop_2_true-unreach-call_false-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.153
while_infinite_loop_3_true-unreach-call_false-termination.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
while_infinite_loop_4_false-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.146
Total Below Time = 9.96 (was 9.843)
Above Time = 9.828 (was 9.895)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive
Ackermann01_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
Ackermann02_false-unreach-call_false-termination.c below duet EXCEPTION
0.145
above EXCEPTION
0.149
Ackermann03_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.146
Ackermann04_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
Addition01_true-unreach-call_true-termination.c below duet EXCEPTION
0.156
above EXCEPTION
0.148
Addition02_false-unreach-call_false-termination.c below duet EXCEPTION
0.151
above EXCEPTION
0.15
Addition03_false-no-overflow.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
Addition03_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
BallRajamani-SPIN2000-Fig1_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
EvenOdd01_true-unreach-call_true-termination.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
EvenOdd03_false-unreach-call_false-termination.c below duet EXCEPTION
0.146
above EXCEPTION
0.146
Fibonacci01_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
Fibonacci02_true-unreach-call_true-termination.c below duet EXCEPTION
0.149
above EXCEPTION
0.154
Fibonacci03_true-unreach-call_true-termination.c below duet EXCEPTION
0.146
above EXCEPTION
0.152
Fibonacci04_false-unreach-call_true-termination.c below duet EXCEPTION
0.151
above EXCEPTION
0.157
Fibonacci05_false-unreach-call_true-termination.c below duet EXCEPTION
0.147
above EXCEPTION
0.152
gcd01_true-unreach-call_true-termination.c below duet EXCEPTION
0.15
above EXCEPTION
0.146
gcd02_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.149
McCarthy91_false-unreach-call_false-termination.c below duet EXCEPTION
0.158
above EXCEPTION
0.154
McCarthy91_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.146
MultCommutative_true-unreach-call_true-termination.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
Primes_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.15
recHanoi01_true-unreach-call_true-termination.c below duet EXCEPTION
0.151
above EXCEPTION
0.146
recHanoi02_true-unreach-call_true-termination.c below duet EXCEPTION
0.149
above EXCEPTION
0.149
recHanoi03_true-unreach-call_true-termination.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
Total Below Time = 3.734 (was 3.75)
Above Time = 3.741 (was 3.731)
/home/turetsky/Newton/WALi-OpenNWA/Examples/cprover/tests/sv-benchmarks/recursive-simple
afterrec_2calls_false-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.148
afterrec_2calls_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
afterrec_false-unreach-call.c below duet EXCEPTION
0.147 (0.211)
above EXCEPTION
0.15
afterrec_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
fibo_10_false-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
fibo_10_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
fibo_15_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
fibo_15_true-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
fibo_20_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
fibo_20_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
fibo_25_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
fibo_25_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.154
fibo_2calls_10_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
fibo_2calls_10_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.147
fibo_2calls_15_false-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.151
fibo_2calls_15_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.15
fibo_2calls_20_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
fibo_2calls_20_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
fibo_2calls_25_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
fibo_2calls_25_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
fibo_2calls_2_false-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.149
fibo_2calls_2_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
fibo_2calls_4_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
fibo_2calls_4_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
fibo_2calls_5_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
fibo_2calls_5_true-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
fibo_2calls_6_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
fibo_2calls_6_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
fibo_2calls_8_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
fibo_2calls_8_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
fibo_5_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
fibo_5_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.15
fibo_7_false-unreach-call.c below duet EXCEPTION
0.158
above EXCEPTION
0.147
fibo_7_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.148
id2_b2_o3_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
id2_b3_o2_false-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.147
id2_b3_o5_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.151
id2_b5_o10_true-unreach-call.c below duet EXCEPTION
0.152
above EXCEPTION
0.161
id2_i5_o5_false-unreach-call.c below duet EXCEPTION
0.22 (0.151)
above EXCEPTION
0.146
id2_i5_o5_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.15
id_b2_o3_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.165
id_b3_o2_false-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.147
id_b3_o5_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
id_b5_o10_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.153 (0.31)
id_i10_o10_false-unreach-call.c below duet EXCEPTION
0.318 (0.163)
above EXCEPTION
0.155
id_i10_o10_true-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.151
id_i15_o15_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.155
id_i15_o15_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
id_i20_o20_false-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
id_i20_o20_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.151
id_i25_o25_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
id_i25_o25_true-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
id_i5_o5_false-unreach-call.c below duet EXCEPTION
0.162
above EXCEPTION
0.153
id_i5_o5_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.15
id_o1000_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.148
id_o100_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
id_o10_false-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.149
id_o200_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.149
id_o20_false-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
id_o3_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
sum_10x0_false-unreach-call.c below duet EXCEPTION
0.155
above EXCEPTION
0.147
sum_10x0_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
sum_15x0_false-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.146
sum_15x0_true-unreach-call.c below duet EXCEPTION
0.151
above EXCEPTION
0.148
sum_20x0_false-unreach-call.c below duet EXCEPTION
0.157
above EXCEPTION
0.151
sum_20x0_true-unreach-call.c below duet EXCEPTION
0.147
above EXCEPTION
0.147
sum_25x0_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.148
sum_25x0_true-unreach-call.c below duet EXCEPTION
0.146
above EXCEPTION
0.147
sum_2x3_false-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.147
sum_2x3_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.148
sum_non_eq_false-unreach-call.c below duet EXCEPTION
0.148
above EXCEPTION
0.147
sum_non_eq_true-unreach-call.c below duet EXCEPTION
0.15
above EXCEPTION
0.156
sum_non_false-unreach-call.c below duet EXCEPTION
0.149
above EXCEPTION
0.147
sum_non_true-unreach-call.c below duet EXCEPTION
0.154
above EXCEPTION
0.146
Total Below Time = 11.292 (was 11.24)
Above Time = 11.032 (was 11.201)

>25% better
25%-10% better
No significant change
10%-25% worse
>25% worse