Skip to main content

​
Overview

The Usage dashboard tracks your API consumption, helping you monitor requests, tokens, and costs.
Free Plan accounts have no API usage to monitor since they only have access to the Studio Playground. Upgrade to Pay-as-you-go to access API usage monitoring.

​
Accessing Usage

  1. Log in to Gloo AI Studio
  2. Select your organization from the organization switcher
  3. Click Usage in the BUILD section of the main navigation
The dashboard displays your API usage metrics, costs, and trends over time.

​
Available Metrics

The Usage dashboard tracks the following API metrics: API Requests: Total number of API calls made to Gloo AI services Token Usage:
  • Prompt tokens (input sent to the API)
  • Completion tokens (output generated by the API)
  • Total tokens (combined)
Cost/Spend: Actual costs incurred based on your API usage Date Ranges: View usage over custom time periods (day, week, month, or custom range)
Understanding your token usage helps you optimize costs. Shorter prompts and responses consume fewer tokens and cost less.

​
Filtering Usage Data

The Usage dashboard provides multiple filtering options to help you analyze API usage patterns. By Organization If you’re an admin with access to multiple organizations, you can filter usage by organization using the organization filter dropdown. Select the organization you want to analyze, and usage metrics will update to show only that organization’s data. When this is useful: Admins managing multiple organizations can track usage and costs separately for each org. By API Credential Filter usage by specific API credential to see which applications or integrations are consuming resources. In the API Credential dropdown, select a Client ID from your API credentials to view usage specific to that credential. When this is useful: Track usage per application, environment (development vs. production), or team to identify optimization opportunities. By View (Requests or Tokens) Toggle between different views to focus on specific metrics:
  • Requests: View the number of API calls over time
  • Tokens: View prompt and completion token consumption
Use the View by selector to switch between these views. By Date Range Select custom date ranges to analyze usage patterns using the Date Range selector. Choose a preset range or select a custom date range to view usage for that period.

​
API Usage by Capability

The Usage dashboard also shows your API usage broken down by capability (Models, Chat, etc.), helping you understand which features are driving your consumption.

​
Understanding Your API Usage

Request Counts Each call to the Gloo AI API counts as one request, regardless of the size of the input or output. Requests are tracked by:
  • Endpoint called (e.g., Chat, Recommendations)
  • Timestamp
  • API credential used
  • Response status (success or error)
Use request counts to understand your application’s call patterns and identify peak usage times. Token Metrics Tokens are the fundamental units of text processing in AI models. Understanding token usage helps you optimize costs:
  • Prompt Tokens: The number of tokens in your input to the API (your request, context, and system messages)
  • Completion Tokens: The number of tokens in the API’s response (the generated text)
Pricing is typically based on token consumption. More tokens = higher cost. Completion tokens often cost more than prompt tokens.
Different models have different token costs. Check our pricing page for current rates.
Cost Tracking The Usage dashboard displays your costs based on actual API usage:
  • Daily costs: Total spend per day
  • Weekly totals: Rolling 7-day spend (relevant for Pay-as-you-go limits)
  • Monthly totals: Cumulative spend for the billing period
For Pay-as-you-go accounts: Costs are tracked against your weekly spend limit. You’ll see warnings as you approach your limit. For Enterprise accounts: Costs contribute to your monthly invoice total.

​
Rate Limits vs. Spend Limits

It’s important to understand the difference between rate limits and spend limits:
  • Rate Limits: Control how quickly you can make API requests (requests per minute/hour). Rate limits prevent abuse and ensure fair usage. See the API Reference for current rate limits.
  • Spend Limits: (Pay-as-you-go only) Control your weekly spending to prevent unexpected costs. When you hit your spend limit, API access pauses until the limit resets.
Rate limits control request speed. Spend limits (Pay-as-you-go only) control weekly spending. See Billing & Plans for details on spend limits.

​
Frequently Asked Questions

How often is usage data updated? API usage data is updated in near real-time, typically within a few minutes of API calls being made. Some aggregated metrics (like daily totals) may take up to an hour to fully update. Can I export usage data? Pay-as-you-go accounts can view usage in the dashboard. Enterprise accounts have access to export features for detailed reports. Contact your account manager for export options. How far back can I view historical data?
  • Pay-as-you-go: 90 days of historical API usage data
  • Enterprise: Extended historical data for the duration of your account
Set up regular usage reviews to identify optimization opportunities and ensure you’re getting the most value from your Gloo AI investment.