Skip to content

ci: avoid duplicate parametric system tests - #4142

Draft
bm1549 wants to merge 2 commits into
masterfrom
brian.marks/remove-duplicate-parametric
Draft

ci: avoid duplicate parametric system tests#4142
bm1549 wants to merge 2 commits into
masterfrom
brian.marks/remove-duplicate-parametric

Conversation

@bm1549

@bm1549 bm1549 commented Aug 27, 2026

Copy link
Copy Markdown
Collaborator

Description

Link (AppGate required)

Tracer-release jobs currently run PARAMETRIC once per weblog, then the dedicated parametric job runs it again. This passes --excluded-scenarios PARAMETRIC to the scenario producer and leaves the dedicated blocking job unchanged.

The generated jobs now extract endtoend_defs.parallel_jobs with a small inline Python block. It sorts and deduplicates scenario names, and fails with one generic error if the producer or parser fails, the result is empty, a name is non-string or contains whitespace, or PARAMETRIC remains.

Expected impact: 26 parametric executions become 1. Based on the CI Visibility sample, that avoids about 7.5 executor-hours per full run. Wall-clock improvement is limited by the next critical-path job.

This revision removes the two Python files and the extra CI test job. The net PR changes only .gitlab/generate-package.php.

Tested with:

  • PHP lint and git diff --check
  • Generated package YAML parse and Bash syntax check
  • All 25 generated tracer-release jobs checked for an identical extraction block
  • Exact embedded parser exercised with canonical, duplicate, empty, malformed, non-string, whitespace-containing, and residual PARAMETRIC inputs

Reviewer checklist

  • Test coverage seems ok.
  • Appropriate labels assigned.

@bm1549 bm1549 added the AI Generated Largely based on code generated by an AI or LLM. This label is the same across all dd-trace-* repos label Aug 27, 2026
@datadog-official

datadog-official Bot commented Aug 27, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🔄 Datadog auto-retried 2 jobs - 2 passed on retry View in Datadog

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 59.62% (-1.01%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: d397123 | Docs | View more details | Give us feedback!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AI Generated Largely based on code generated by an AI or LLM. This label is the same across all dd-trace-* repos

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant