Libraries & SDKs

Gloo AI is OpenAI-compatible, so you can use the official OpenAI SDKs for Python and Node.js without learning a new syntax. Authentication works the same way as OpenAI — pass your API key as the api_key parameter, and it’s sent as a bearer token on every request. Get one from the API Keys page in Gloo AI Studio. What sets Gloo apart is the platform-specific extensions to the OpenAI specification — auto_routing, model_family, tradition, grounded completions, and response routing metadata. The compatibility matrix below maps the differences. Gloo supports both the Responses API (recommended for new integrations) and Chat Completions.

Recommended: build new integrations on the Responses API. With the OpenAI SDK, point the client at the /ai/v2/guarded base URL and call responses.create:

client = OpenAI(
    api_key=os.getenv("GLOO_API_KEY"),
    base_url="https://platform.ai.gloo.com/ai/v2/guarded",
)
resp = client.responses.create(
    model="gloo-anthropic-claude-sonnet-4.6",
    input="Hello world!",
)
print(resp.output_text)

The Chat Completions examples below use the same /ai/v2/guarded base URL and remain fully supported — one base URL serves both responses.create and chat.completions.create.

Authentication: use your API key the same way you would with OpenAI — pass it as the api_key parameter in the SDK client. Get a key from the API Keys page in Gloo AI Studio.

Python

The Python library is the standard for AI engineering and data science.

Install the libraries

Use pip to install the OpenAI package.

pip install openai python-dotenv

Set up environment variables

Create a .env file with your API key:

GLOO_API_KEY=your_api_key_here

Configure the client

Initialize the OpenAI client with your API key.

import os
from openai import OpenAI
from dotenv import load_dotenv

load_dotenv()

client = OpenAI(
    api_key=os.getenv("GLOO_API_KEY"),
    base_url="https://platform.ai.gloo.com/ai/v2/guarded"
)

completion = client.chat.completions.create(
    model="gloo-anthropic-claude-sonnet-4.5",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello world!"}
    ]
)

print(completion.choices[0].message.content)

For production applications, store your API key in a secrets manager rather than in plaintext .env files. See the Authentication Tutorial for secure key handling patterns.

Node.js / TypeScript

Perfect for full-stack developers and web applications.

Install the libraries

npm install openai dotenv

Set up environment variables

Create a .env file with your API key:

GLOO_API_KEY=your_api_key_here

Configure the client

Initialize the OpenAI client with your API key.

import OpenAI from "openai";
import * as dotenv from "dotenv";

dotenv.config();

async function main() {
  const client = new OpenAI({
    apiKey: process.env.GLOO_API_KEY!,
    baseURL: "https://platform.ai.gloo.com/ai/v2/guarded",
  });

  const completion = await client.chat.completions.create({
    model: "gloo-anthropic-claude-sonnet-4.5",
    messages: [{ role: "user", content: "Say this is a test" }],
  });

  console.log(completion.choices[0].message.content);
}

main();

For production applications, store your API key in a secrets manager rather than in plaintext .env files. See the Authentication Tutorial for secure key handling patterns.

OpenAI Compatibility

Gloo AI’s primary completions endpoint (/ai/v2/guarded/chat/completions) is shaped like OpenAI Chat Completions, so any client that accepts a custom base_url and api_key works with minimal changes. The table below maps standard fields to Gloo AI equivalents and highlights differences unique to the platform.

Compatibility Matrix

Capability	OpenAI	Gloo AI
Authentication	Static API key	Same — API key passed as `api_key` (bearer token)
Base URL	`https://api.openai.com/v1`	`https://platform.ai.gloo.com/ai/v2/guarded`
`messages`	Required	Required — same format
`model`	Required	Required by the SDK client; omit only when using `auto_routing` or `model_family` via direct HTTP
`stream`	Supported	Supported
`temperature`	Supported	Supported
`max_tokens`	Supported	Supported
`tools` / `tool_choice`	Supported	Supported
`auto_routing`	Not supported	Gloo-specific — let Gloo pick the best model automatically
`model_family`	Not supported	Gloo-specific — pick by provider (`openai`, `anthropic`, `google`, `open source`)
`tradition`	Not supported	Gloo-specific — theological perspective filter (`evangelical`, `catholic`, `mainline`)
Response routing metadata	Not included	Gloo-specific — `provider`, `model_family`, `routing_mechanism`, `routing_tier`, `routing_confidence` added to every response
Grounded (RAG) completions	Not supported	Gloo-specific — separate path `/ai/v2/grounded/chat/completions`; `base_url` and `model` differ

Exactly one routing mechanism must be specified on every V2 request: auto_routing: true, model, or model_family. Unlike the OpenAI API, model is not always required—set auto_routing: true to have Gloo choose the best model automatically.

Passing Gloo-Specific Parameters

How you pass Gloo-specific fields depends on whether you’re specifying a model directly or using Gloo’s routing. Using a model directly with optional filters (e.g. tradition) When model is present, the SDK is satisfied and you only need to forward the extra Gloo fields. In Python, use extra_body. In TypeScript, the OpenAI SDK doesn’t have extra_body, so use the client’s low-level .post() method instead.

response = client.chat.completions.create(
    model="gloo-anthropic-claude-haiku-4.5",
    messages=[{"role": "user", "content": "What does Ephesians 2:8-9 mean?"}],
    extra_body={"tradition": "evangelical"},
)
print(response.choices[0].message.content)

// TypeScript SDK has no extra_body; use the client's .post() instead
const response = await (client as any).post('/chat/completions', {
  body: {
    model: 'gloo-anthropic-claude-haiku-4.5',
    messages: [{ role: 'user', content: 'What does Ephesians 2:8-9 mean?' }],
    tradition: 'evangelical',
  },
});
console.log(response.choices[0].message.content);

Using Gloo routing (auto_routing or model_family) Both SDKs enforce model as a required argument client-side. Since Gloo’s routing modes are designed to be used without a model field, you need to bypass the SDK validation entirely and call the API directly.

import requests

response = requests.post(
    "https://platform.ai.gloo.com/ai/v2/guarded/chat/completions",
    headers={
        "Authorization": f"Bearer {os.getenv('GLOO_API_KEY')}",
        "Content-Type": "application/json",
    },
    json={
        "messages": [{"role": "user", "content": "What does Ephesians 2:8-9 mean?"}],
        "auto_routing": True,
        "tradition": "evangelical",
    },
)
response.raise_for_status()
print(response.json()["choices"][0]["message"]["content"])

const response = await (client as any).post('/chat/completions', {
  body: {
    messages: [{ role: 'user', content: 'What does Ephesians 2:8-9 mean?' }],
    auto_routing: true,
    tradition: 'evangelical',
  },
});
console.log(response.choices[0].message.content);

The Grounded Completions endpoint uses a different base URL (https://platform.ai.gloo.com/ai/v2/grounded) and requires rag_publisher and other Gloo-specific fields. Use the same direct HTTP approach above. See the Grounded Completions guide for full details.

GlooCode — AI Coding Agent

If you want a fully autonomous coding agent rather than editor autocomplete, check out GlooCode. It runs as a standalone terminal agent that can plan, build, test, and commit code on its own — at up to 60–70% lower cost than equivalent direct-provider pricing.

GlooCode is the only Gloo product that still uses the legacy Client ID / Client Secret credentials rather than an API key. The OAuth2 token-exchange flow it requires is being deprecated for the rest of the platform, but GlooCode is not yet compatible with API keys. If you use GlooCode, keep your existing Client ID / Client Secret credentials active. See the GlooCode installation guide for setup instructions.

Vibe Coding & Editor Setup

Because Gloo AI adheres to open standards, you can use it directly inside AI-native code editors (like Cursor, Windsurf, or VS Code) to “vibe code” with values-aligned models.

Cursor / VS Code

Go to Settings > Models
Add a Custom Provider
Set URL: https://platform.ai.gloo.com/ai/v2/guarded
Paste your API key

Agent Frameworks

Compatible with LangChain, CrewAI, and AutoGen by setting the openai_api_base parameter and providing your API key.

Your API key doesn’t expire, but if you rotate it, update the key in your editor’s custom provider settings. See the API Keys page to manage keys.

Connect our docs to your AI tools via MCP. Get accurate API references, model IDs, and code examples directly in your editor or AI assistant. See the MCP Integration guide to set up in one click.

Supported Models

When using the SDK, you must use the exact Model IDs supported by Gloo AI. Here are some commonly used models:

Provider	Model ID
Anthropic	`gloo-anthropic-claude-sonnet-4.5`
Anthropic	`gloo-anthropic-claude-haiku-4.5`
OpenAI	`gloo-openai-gpt-5-mini`
Google	`gloo-google-gemini-2.5-flash`
Open Source	`gloo-meta-llama-3.1-8b-instruct`

See the Supported Models page for the full list of available Model IDs and their capabilities.

Get Started

Responses & Completions

Content

Organization & Billing

GlooCode

Learn More

External

Legacy

Libraries & SDKs

Python

Node.js / TypeScript

OpenAI Compatibility

Compatibility Matrix

Passing Gloo-Specific Parameters

GlooCode — AI Coding Agent

Vibe Coding & Editor Setup

Cursor / VS Code

Agent Frameworks

Supported Models

​Python

​Node.js / TypeScript

​OpenAI Compatibility

​Compatibility Matrix

​Passing Gloo-Specific Parameters

​GlooCode — AI Coding Agent

​Vibe Coding & Editor Setup

Cursor / VS Code

Agent Frameworks

​Supported Models

Python

Node.js / TypeScript

OpenAI Compatibility

Compatibility Matrix

Passing Gloo-Specific Parameters

GlooCode — AI Coding Agent

Vibe Coding & Editor Setup

Supported Models