Skip to content

Document / gate Ultra multi-agent features when using API-key custom model_providers #37859

Description

@RaviTharuma

What version of Codex CLI is running?

0.147.0 (CLI + Desktop)

What subscription do you have?

ChatGPT Pro for account features; inference often via custom model_providers with API key (wire_api = "responses", env_key, requires_openai_auth = false).

Which model were you using?

gpt-5.6-sol with model_reasoning_effort = "ultra" on a custom API provider.

What platform is your computer?

macOS (applies generally)

What issue are you seeing?

Codex currently advertises or accepts Ultra-related settings for sessions that use a regular API-key model provider, but several Ultra product capabilities only work on the ChatGPT / first-party backend path.

Concretely:

Capability ChatGPT-auth / first-party provider Regular API-key model_providers.*
Reasoning effort ultra works often works (effort enum only)
Server-side multi-agent / Responses multi_agent works fails (Unsupported parameter: multi_agent or no multi-agent tree)
Native Ultra-style parallel subagent product works incomplete / broken (see #17598, #37858)
Client multi_agent_v2 / spawn_agent works partial; known custom-provider bugs

Users reasonably assume that:

model_provider = "my_api"   # API key provider
model = "gpt-5.6-sol"
model_reasoning_effort = "ultra"
[features]
multi_agent_v2 = true

means they get the same Ultra multi-agent experience as ChatGPT-signed-in Codex. They do not. There is no clear in-product warning, and docs do not draw a hard line between:

  1. Ultra as reasoning effort (portable to many providers), vs
  2. Ultra as multi-agent product (ChatGPT-backend / first-party only today).

What steps can reproduce the bug?

  1. Configure any working custom Responses API provider with API key auth.
  2. Set Sol + model_reasoning_effort = "ultra" + enable multi-agent features.
  3. Use Desktop/CLI as if Ultra multi-agent were fully available (spawn parallel subagents, multi-agent coordination).
  4. Observe failures or silent single-agent answers; switch to ChatGPT-auth default provider and see full behavior.

What is the expected behavior?

Please do one or both of:

  1. Document in config reference / subagents / models docs:
    • which Ultra capabilities require ChatGPT authentication / first-party backend
    • which work with arbitrary Responses-compatible API providers
  2. Gate or label in UI/CLI when model_provider is a custom API-key provider:
    • show that multi-agent Ultra is unavailable or degraded
    • avoid implying that effort=ultra alone enables full Ultra multi-agent

Without this, power users waste time debugging config when the limit is product architecture.

Additional information

Related:

This issue is specifically about honest product surface + docs, not only the protocol fix requested in #37858.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    CLIIssues related to the Codex CLIconfigIssues involving config.toml, config keys, config merging, or config updatescustom-modelIssues related to custom model providers (including local models)enhancementNew feature or requestsubagentIssues involving subagents or multi-agent features

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions