Skip to content

chore: remove deprecated models from the catalog - #1265

Open
github-actions[bot] wants to merge 1 commit into
mainfrom
chore/model-deprecation-audit
Open

github-actions[bot] wants to merge 1 commit into
mainfrom
chore/model-deprecation-audit

Conversation

@github-actions

@github-actions github-actions Bot commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

Model deprecation audit

Each model below returned a definitive not-found / deprecated response from its provider (a single 404 / not-found is treated as authoritative). Account/region-scoped providers (bedrock, vertex, databricks) are surfaced for manual review, not auto-removed.

{
  "deprecations": [
    {
      "model": "claude-mythos-5-1",
      "provider": "anthropic",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\"type\":\"error\",\"error\":{\"type\":\"not_found_error\",\"message\":\"model: claude-mythos-5-1\"},\"request_id\":\"req_011CfASxBYrRpxqxGTjfkanh\"}"
    },
    {
      "model": "gpt-daybreak-blue-latest",
      "provider": "azure",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\n    \"error\": {\n        \"message\": \"The model `gpt-daybreak-blue-latest` does not exist or you do not have access to it.\",\n        \"type\": \"invalid_request_err"
    },
    {
      "model": "gpt-daybreak-red-latest",
      "provider": "azure",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\n    \"error\": {\n        \"message\": \"The model `gpt-daybreak-red-latest` does not exist or you do not have access to it.\",\n        \"type\": \"invalid_request_erro"
    },
    {
      "model": "gemma-4-31b",
      "provider": "cerebras",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\"message\":\"Model gemma-4-31b is archived and unavailable for the organization.\",\"type\":\"model_archived_error\",\"param\":\"model\",\"code\":\"model_archived\"}"
    },
    {
      "model": "qwen/qwen3.6-27b",
      "provider": "groq",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\"error\":{\"message\":\"The model `qwen/qwen3.6-27b` does not exist or you do not have access to it.\",\"type\":\"invalid_request_error\",\"code\":\"model_not_found\"}}\n"
    },
    {
      "model": "gpt-daybreak-blue-latest",
      "provider": "openai",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\n    \"error\": {\n        \"message\": \"The model `gpt-daybreak-blue-latest` does not exist or you do not have access to it.\",\n        \"type\": \"invalid_request_err"
    },
    {
      "model": "gpt-daybreak-red-latest",
      "provider": "openai",
      "reason": "absent from list + probe not-found",
      "status": 404,
      "detail": "{\n    \"error\": {\n        \"message\": \"The model `gpt-daybreak-red-latest` does not exist or you do not have access to it.\",\n        \"type\": \"invalid_request_erro"
    },
    {
      "model": "gemini-2.5-pro-preview-05-06",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "ibm-granite/granite-4.1-8b",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "inception/mercury-2.5-preview",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "mistral-large-2512",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "nex-agi/nex-n2-mini",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "nex-agi/nex-n2-pro",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "nousresearch/hermes-4-70b",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    },
    {
      "model": "qwen/qwen3.8-max",
      "provider": "openrouter",
      "reason": "absent from provider model list"
    }
  ],
  "reportOnly": [
    {
      "provider": "bedrock",
      "modelCount": 146
    },
    {
      "provider": "databricks",
      "modelCount": 54
    },
    {
      "provider": "fireworks",
      "modelCount": 281
    },
    {
      "provider": "vertex",
      "modelCount": 113
    }
  ],
  "skipped": [
    {
      "provider": "lepton",
      "reason": "no adapter"
    },
    {
      "provider": "replicate",
      "reason": "no adapter"
    },
    {
      "provider": "typesafe",
      "reason": "no adapter"
    }
  ]
}

@vercel

vercel Bot commented Sep 17, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
ai-proxy Ready Ready Preview Sep 18, 2026 6:43am UTC

Request Review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 63ede7e985

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment on lines +73 to +74
"gpt-daybreak-blue-latest",
"gpt-daybreak-red-latest",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Preserve the gated Daybreak aliases

Do not blacklist these two aliases based on this audit: its recorded response says the model either does not exist or the account lacks access, while reconcile_provider_models.ts:49-62 explicitly documents that the Daybreak preview family returns false 404s for non-entitled CI credentials and must be preserved. These entries also point to the still-preserved daybreak-*-latest models with identical provider metadata, so entitled customers using the gpt-daybreak-*-latest spelling will lose catalog/routing support. Restore both aliases and add their spellings to NEVER_DEPRECATE_MODELS unless a source independent of the gated CI account confirms removal.

Useful? React with 👍 / 👎.

Comment on lines +86 to +87
"grok-imagine-video-1.5-2026-05-30",
"grok-imagine-video-1.5-preview",

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Exclude video-generation IDs from chat probes

Restore these video model variants rather than permanently excluding them based on the reported 400. The xAI adapter probes suspected models through /chat/completions (model_probe.ts:166-170), but these are video-generation IDs; unlike image/audio models, NON_CHAT_MODEL_PATTERN in reconcile_provider_models.ts:65-75 does not skip video. A video endpoint returning “Model not found” to a chat request therefore does not prove the model was retired, and users of the dated or preview IDs lose them while the sibling grok-imagine-video-1.5 remains cataloged. Skip video models or validate them through the appropriate modality-specific endpoint before deprecating them.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant