You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Scores on the Interop Dashboard are aggregated using the first set of aligned runs available for each day. However, it is not uncommon for multiple sets of aligned runs to be available for each day. On the test results pages, the most recent set of aligned runs is displayed, even though this may not be the set of runs that are used to score the runs on the Interop Dashboard. This means that test flakiness or very recent (less than a day) updates to test results can present variations in the scores. We can avoid confusion here by making sure that the same set of aligned runs that were used to score the most recent scores in the dashboard are the runs that are displayed on the results page.
The text was updated successfully, but these errors were encountered:
DanielRyanSmith
changed the title
Interop results page shows most recent aligned run results, which may not have been used to score the dashboard
Interop results page shows most recent aligned run results, which may not have been used to score the Interop Dashboard
Dec 10, 2024
Scores on the Interop Dashboard are aggregated using the first set of aligned runs available for each day. However, it is not uncommon for multiple sets of aligned runs to be available for each day. On the test results pages, the most recent set of aligned runs is displayed, even though this may not be the set of runs that are used to score the runs on the Interop Dashboard. This means that test flakiness or very recent (less than a day) updates to test results can present variations in the scores. We can avoid confusion here by making sure that the same set of aligned runs that were used to score the most recent scores in the dashboard are the runs that are displayed on the results page.
This will probably require making the specific run IDs used to aggregate the score available for the dashboard client to use to populate the links to each focus area result. Interop scores are aggregated using the results-analysis script.
The text was updated successfully, but these errors were encountered: