Skip to content

[feat] Support discrete testcase filters when comparing performance #3438

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

vkarak
Copy link
Contributor

@vkarak vkarak commented Mar 24, 2025

This PR allows user to specify the -E twice when combined with the --performance-compare option, in which case each of the filter expression will be applied to the corresponding testcase set.

Closes #3437.

@vkarak vkarak added prio: normal enhancement reporting Issues related to reporting and processing the test results labels Mar 24, 2025
@vkarak vkarak added this to the ReFrame 4.8 milestone Mar 24, 2025
@vkarak vkarak self-assigned this Mar 24, 2025
@vkarak vkarak requested a review from victorusu March 31, 2025 19:57
Copy link
Contributor

@victorusu victorusu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@github-project-automation github-project-automation bot moved this from Todo to In Progress in ReFrame Backlog Apr 4, 2025
@vkarak vkarak enabled auto-merge April 5, 2025 09:31
@vkarak vkarak merged commit fcede1a into reframe-hpc:develop Apr 5, 2025
37 checks passed
@github-project-automation github-project-automation bot moved this from In Progress to Done in ReFrame Backlog Apr 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement prio: normal reporting Issues related to reporting and processing the test results
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Support performance comparisons between testcases based on disjoint filtering criteria
2 participants