Skip to main content
Gloo AI is OpenAI-compatible, so most apps move by changing a base URL, a key and a model ID. Direct endpoints are the like-for-like move: you pay the model’s published rate. For Gloo’s guardrails and values alignment, use the guarded base URL; the request is the same.

Before you start

You need a funded Gloo AI Studio account and an API key. If you don’t have them yet, follow steps 1 to 4 of the Developer Quickstart.

Move in four steps

1

Point your client at Gloo

Set the base URL to https://platform.ai.gloo.com/ai/v2/direct and use your Gloo API key as the key. The rest of the client call stays the same, with one exception for stateful Responses in step 3.
2

Use a Gloo model ID

Gloo model IDs look like gloo-<provider>-<model>, for example gloo-anthropic-claude-opus-5.5. Find the ID for the model you use today on Supported Models or with GET /platform/v2/models, which also returns each model’s context window, capabilities and rates.
3

Keep your call shape

Both OpenAI formats work on direct endpoints, so you can keep the one you already use.
  • Chat Completions (client.chat.completions.create) goes to /ai/v2/direct/chat/completions. See Direct Completions.
  • Responses (client.responses.create) goes to /ai/v2/direct/responses. See Direct Responses. Direct Responses does not support previous_response_id. If your app chains a conversation that way, send the full history in input on each request instead.
  • Embeddings (client.embeddings.create) uses the same base URL. See Embeddings.
  • Anthropic SDK (client.messages.create) for Claude models: keep it, with the base URL https://platform.ai.gloo.com/ai/v2/direct/anthropic and your Gloo API key as auth_token. See Anthropic Messages.
If you use another provider’s own SDK, switch that call to one of the OpenAI formats above.
4

Test, then switch over

Run a few real requests through Gloo before you move traffic. Read the model and usage in each response, and watch spend in API Usage. Keep your old base URL and key behind a setting so you can switch back in a deploy.

Using a framework?

LangChain and CrewAI work by setting the openai_api_base parameter to the Gloo base URL and passing your API key. AutoGen’s OpenAIChatCompletionClient takes base_url instead, and for models it does not recognize it also needs model_info; see AutoGen’s migration guide. Editors and agents that accept a custom OpenAI-compatible provider work the same way. See Libraries & SDKs.

What else you get

On Gloo you also get:
  • Provider failover. If the provider serving a model is failing, Gloo can send your request to another provider that serves the same model. See Provider Failover.
  • Retired models keep working. When a provider retires a model, requests are routed to its replacement. See Model Lifecycle.
  • Guardrails and values alignment. Guarded endpoints screen requests, moderate answers and align them to a tradition you choose, priced at the model’s rate plus 6.5%; same request, different base URL.
  • Your own content. Grounded Responses answer from your library. This needs Data Engine access.

Parameters a model can’t use

On Direct Completions and Direct Responses, a sampling parameter the model can’t take (such as temperature on some reasoning models) is dropped. The request still succeeds, and the parameter is listed in ignored_params in the response body, or by name in the X-Ignored-Params header on a stream. The guarded and grounded Completions and Responses endpoints report it the same way; Embeddings does not. A value the provider rejects still returns 400 with 1001 / INVALID_REQUEST. Check for both while you test. See Errors.

Need help?

Use Support at the bottom of the Studio sidebar. It is the fastest way to reach us. See Get help.

Next steps

Libraries & SDKs

Set up the OpenAI or Anthropic SDK against Gloo.

Direct Responses

The like-for-like move from OpenAI’s Responses API.

Responses

The same request with Gloo’s guardrails, moderation and tradition.