Skip to content

feat(bench): add local-coder benchmark harness - #12

Merged
phaedrus-on-git merged 1 commit into
mainfrom
feat/local-coder-benchmark-harness
Sep 6, 2026
Merged

feat(bench): add local-coder benchmark harness#12
phaedrus-on-git merged 1 commit into
mainfrom
feat/local-coder-benchmark-harness

Conversation

@phaedrus-on-git

Copy link
Copy Markdown
Collaborator

Summary

  • adds a streamed devrail-router bench command for fixed OpenAI-compatible chat benchmark cases
  • records request ID, HTTP status, first SSE event latency, duration, response bytes, streamed usage tokens, and first content sample as JSONL
  • includes default local-coder cases and benchmarking docs for llm-srv

Validation

  • go test ./...
  • make check
  • make package-smoke GOOS=linux GOARCH=amd64
  • live sample against http://llm-srv-01.mfsoho.linkridge.net:18080/v1 with -model local-coder -max-tokens 256: 3/3 cases returned 200, first_event_ms 513-690, duration_ms 4024-4206

@phaedrus-on-git
phaedrus-on-git merged commit c1f3182 into main Sep 6, 2026
8 checks passed
@phaedrus-on-git
phaedrus-on-git deleted the feat/local-coder-benchmark-harness branch September 6, 2026 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant