You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Our regression tests mostly have expected results that can be tested against, but none of our benchmarks do. This means it's impossible to know when Goblint has become better or worse on them and to track regressions in benchmarks automatically.
Various degrees of expected results would be possible:
Explicit annotations in benchmark sources, using a common mechanism with regression tests.
Expected statistics: race counts, warning counts (by category), etc.
Our regression tests mostly have expected results that can be tested against, but none of our benchmarks do. This means it's impossible to know when Goblint has become better or worse on them and to track regressions in benchmarks automatically.
Various degrees of expected results would be possible:
The text was updated successfully, but these errors were encountered: