-
Notifications
You must be signed in to change notification settings - Fork 76
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ldv-benchmarks races benchmarking #618
Conversation
Ok, I think it's hopeless to get any meaningful results on these benchmarks for now for two reasons (more info here: goblint/bench#3 (comment)):
For these reasons I think almost all of the results I got from running these are invalid since they are unsound in one way or another, leaving most code dead, even if the SV-COMP result happens to come out right. Nevertheless, we should merge this PR since it contains one base unsoundness fix and an unsoundness test for var_eq. |
Besides the region analysis causing unsoundness (#107), which doesn't show in the verdicts, it's also completely unsuitable for interactive benchmarking since the region partitioning is stored under a single global unknown and it's not clear whether this could be any different. |
The unsoundness fix contained here is actually relevant on sv-benchmarks as well. From the same kernel module there's a benchmark |
Since this is small and contains a possibly important unsoundness fix, I'll just merge it. |
Goblint changes for benchmarking goblint/bench#3.
Changes
ValueDomain.is_safe_cast
to correctly handle casts between signed and unsigned. This caused unsoundness in someinvariant
(test added).Problems
Machdep
) which are incompatible with those preprocessed into ldv-benchmarks:sv-comp.c
stub doesn't explicitly define or include any__builtin_bswap16
, so it must be coming from CIL's builtins.ldv-commits-races/tasks/f1a8a3f-1.cil.i
unsound. Uses custompthread_create_N
.ldv-commits-races/tasks/4036523-1.i
unsound. Uses custompthread_create_N
.linux-4.2.6-races/Unsafes/u__linux-concurrency_safety__drivers---net---irda---ksdazzle-sir.ko.cil.i
unsound. Model appears to be wrong forusb_endpoint_dir_in
(bitwise op replaced with tautological unsigned comparison).linux-4.18-races/Unsafes/u__linux-concurrency_safety__drivers---net---ethernet---8390---ax88796.ko.cil.i
unsound. Model appears to be wrong forax_reset_8390
(bitwise op replaced with tautological unsigned comparison).