Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interop results page shows most recent aligned run results, which may not have been used to score the Interop Dashboard #4160

Open
DanielRyanSmith opened this issue Dec 10, 2024 · 0 comments

Comments

@DanielRyanSmith
Copy link
Contributor

DanielRyanSmith commented Dec 10, 2024

Scores on the Interop Dashboard are aggregated using the first set of aligned runs available for each day. However, it is not uncommon for multiple sets of aligned runs to be available for each day. On the test results pages, the most recent set of aligned runs is displayed, even though this may not be the set of runs that are used to score the runs on the Interop Dashboard. This means that test flakiness or very recent (less than a day) updates to test results can present variations in the scores. We can avoid confusion here by making sure that the same set of aligned runs that were used to score the most recent scores in the dashboard are the runs that are displayed on the results page.

This will probably require making the specific run IDs used to aggregate the score available for the dashboard client to use to populate the links to each focus area result. Interop scores are aggregated using the results-analysis script.

@DanielRyanSmith DanielRyanSmith changed the title Interop results page shows most recent aligned run results, which may not have been used to score the dashboard Interop results page shows most recent aligned run results, which may not have been used to score the Interop Dashboard Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant