Skip to content

test: add cross-process or multi-worker runtime validation for example integrations #38

Description

@rlippmann

Proposed enforcement point

runtime concurrency and process-boundary validation

Domain

cross-process and multi-worker integration behavior

Runtime or framework

LiteLLM Proxy / Open WebUI / other runtime-backed integrations as applicable

Why existing examples do not cover it

Current tests primarily validate in-process behavior and single-worker runtime smoke paths. The repository does not yet cover the cases where runtime behavior changes across process boundaries or under multi-worker execution.

This gap may include:

  • LiteLLM Proxy behavior with more than one worker
  • checkpoint/state behavior across process boundaries where relevant
  • explicit validation of examples that intentionally do not provide cross-process guarantees
  • documentation and test coverage for which integrations are single-process teaching examples versus runtime surfaces that should tolerate worker/process boundaries

This should be tracked separately from both the Open WebUI loading/registration gap and any future streaming-specific validation work.

Where does this belong?

context-compiler-example-integrations

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions