Skip to content

ci: weekly scheduled benchmark baseline on main - #147

Open
aarontrowbridge wants to merge 1 commit into
mainfrom
ci/weekly-benchmark-baseline
Open

aarontrowbridge wants to merge 1 commit into
mainfrom
ci/weekly-benchmark-baseline

Conversation

@aarontrowbridge

Copy link
Copy Markdown
Member

Closes #146.

One trigger block: Mondays 03:30 UTC schedule: on benchmark.yml, so the published gh-pages series (the baseline PR benchmark reports diff against) never ages past a week. No benchmark definitions, thresholds, or alert behavior touched. Style matches nightly.yml's schedule block.

Context: during #145 review, the benchmark report diffed against an Aug 21 baseline — six days of main + registry drift masquerading as iteration-count regressions. This keeps the anchor fresh.

The published series anchored PR comparisons to the last release-era
entry (six weeks stale at worst); a weekly main-branch run keeps the
baseline current so PR benchmark reports diff against reality.
(#146)

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'DirectTrajOpt.jl benchmarks'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.20.

Benchmark suite Current: 66ecc8c Previous: 110708d Ratio
scaling_N101_d16_ipopt [wall] 53.411757564 s 7.520233163 s 7.10
scaling_N101_d16_ipopt [alloc] 226877621656 bytes 31020145144 bytes 7.31
scaling_N101_d16_ipopt [iters] 50 iterations 6 iterations 8.33
scaling_N101_d4_ipopt [wall] 2.177957766 s 0.534550853 s 4.07
scaling_N101_d4_ipopt [alloc] 6955784256 bytes 1722050512 bytes 4.04
scaling_N101_d4_ipopt [iters] 50 iterations 11 iterations 4.55
scaling_N25_d8_ipopt [wall] 0.213802688 s 0.007596808 s 28.14
scaling_N25_d8_ipopt [alloc] 799125832 bytes 22601216 bytes 35.36
scaling_N25_d8_ipopt [iters] 4 iterations 0 iterations +∞
scaling_N51_d16_ipopt [wall] 1.681779282 s 1.104382817 s 1.52
scaling_N51_d16_ipopt [alloc] 6625417688 bytes 4518562000 bytes 1.47
scaling_N51_d16_ipopt [iters] 2 iterations 1 iterations 2
scaling_N51_d8_ipopt [wall] 3.875057712 s 2.296990438 s 1.69
scaling_N51_d8_ipopt [alloc] 15592198256 bytes 9284381976 bytes 1.68
scaling_N51_d8_ipopt [iters] 50 iterations 28 iterations 1.79

This comment was automatically generated by workflow using github-action-benchmark.

@codecov

codecov Bot commented Aug 27, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci: weekly scheduled benchmark run on main — keep the comparison baseline fresh

1 participant