Skip to content

[bugfix] Fix reporting of failing performance variables when test defines multiple figures of merit - #3713

Merged
vkarak merged 1 commit into
reframe-hpc:masterfrom
vkarak:bugfix/perfvar-failure-info
Aug 24, 2026
Merged

[bugfix] Fix reporting of failing performance variables when test defines multiple figures of merit#3713
vkarak merged 1 commit into
reframe-hpc:masterfrom
vkarak:bugfix/perfvar-failure-info

Conversation

@vkarak

@vkarak vkarak commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

This also adapts the existing unit tests to catch the original error.

Closes #3712.

Signed-off-by: Vasileios Karakasis <vkarakasis@nvidia.com>
@codecov

codecov Bot commented Aug 24, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.91%. Comparing base (307a37c) to head (aa4686f).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #3713   +/-   ##
=======================================
  Coverage   91.90%   91.91%           
=======================================
  Files          62       62           
  Lines       13782    13783    +1     
=======================================
+ Hits        12667    12668    +1     
  Misses       1115     1115           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@victorusu victorusu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@github-project-automation github-project-automation Bot moved this from Todo to In Progress in ReFrame Backlog Aug 24, 2026
@vkarak
vkarak merged commit 27b6926 into reframe-hpc:master Aug 24, 2026
33 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in ReFrame Backlog Aug 24, 2026
@vkarak
vkarak deleted the bugfix/perfvar-failure-info branch August 24, 2026 22:21
@vkarak vkarak linked an issue Aug 25, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

The wrong performance variable is reported in FAILURE INFO when a test extracts multiple figures of merit Unexpected performance reference failure

2 participants