Release 3.3
-
New API for tool-info modules (needed by
benchexec
for getting information about the benchmarked tool). The new API is defined by classbenchexec.tools.template.BaseTool2
and is similar to the old API, but more convenient to use and provides more useful information to the tool-info module.
The old API is still supported and will be removed no sooner than in BenchExec 4.0. We also provide a migration guide. -
A new parameter
--tool-directory
forbenchexec
allows to specify the installation directory of the benchmarked tool easily without having to modifyPATH
or change into the tool's directory.
Note that this only works if the respective tool-info module makes use of the newBaseTool2
API. -
New version 2.0 of the task-definition format for
benchexec
.
This format allows to specify arbitrary additional information in a key namedoptions
andbenchexec
will pass everything in this key to the tool-info module, but note that this only works if the respective tool-info module makes use of the newBaseTool2
API.
This is useful to add domain-specific information about tasks, for example in the SV-Benchmarks repository it is used to declare the program language.
BenchExec also still supports version 1.0 of the format. -
table-generator
is now defined to work on Windows and we test this in continuous integration.
Previously, it probably was working on Windows most of the time but we did not systematically test this. -
Fix a crash in
benchexec
for task with property but without task-definition file.