Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better benchmark samples for the reachability query #134

Open
Mati-AAU opened this issue Dec 14, 2022 · 0 comments
Open

Better benchmark samples for the reachability query #134

Mati-AAU opened this issue Dec 14, 2022 · 0 comments

Comments

@Mati-AAU
Copy link
Contributor

Mati-AAU commented Dec 14, 2022

The benchmarks for reachability queries have two problems, making them hard to use for measuring improvements or regressions for practical use of them.

Firstly it uses IO like the other benchmarks, see #132
Secondly it currently uses very small and similar samples, making it hard to measure the effectiveness of for example implementing a heuristic.

Our group found a possibly useful link for some XML data specifically for benchmarking reachability that should be able to be read by ECDAR
https://www.labri.fr/perso/herbrete/tchecker/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant