Skip to content

test(mvp): gate Collector correctness, performance, and resources E2E - #605

Merged
zzylol merged 2 commits into
mainfrom
codex/collector-e2e-acceptance
Sep 4, 2026
Merged

zzylol merged 2 commits into
mainfrom
codex/collector-e2e-acceptance

Conversation

@zzylol

@zzylol zzylol commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • sample real Collector self-telemetry counters across each paired four-node load window
  • fail closed on missing/restarted counter evidence, refused points, or exporter failures
  • gate sustained accepted-point throughput, points per CPU-second, per-agent CPU, and peak RSS
  • include Collector runtime evidence in the machine-readable result and MVP report
  • add evaluator and Prometheus parser regression tests

Acceptance contract

  • both agents sustain at least 90% of the declared base workload
  • at least 25k accepted metric points per CPU-second
  • zero refused and zero failed-export metric points
  • at most 4 CPU cores and 4 GiB peak RSS per agent

Validation

  • python3 -m unittest discover -s deploy/mvp-multinode/scripts/tests -v (20 tests)
  • python3 -m py_compile deploy/mvp-multinode/scripts/*.py
  • bash -n deploy/mvp-multinode/scripts/run_demo.sh
  • git diff --check

The physical four-node run is intentionally left for review/cluster execution; missing runtime evidence cannot pass the evaluator.

@zzylol
zzylol merged commit 1d8efd0 into main Sep 4, 2026
1 check passed
@zzylol
zzylol deleted the codex/collector-e2e-acceptance branch September 4, 2026 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant