Skip to main content
Add your TrueFoundry AI Gateway endpoint to access 1000+ models from 40+ providers in Arize AX’s prompt playground and LLM-as-a-judge evaluations. The gateway exposes a single OpenAI-compatible endpoint, so it is added as a Custom Model Endpoint — Arize AX makes use of the OpenAI Client to make calls to it.
By adding this integration, your data may be sent through your TrueFoundry AI Gateway to the underlying model provider for certain actions within Arize AX (e.g., prompt playground) and your account may be billed for usage.

Add the Integration Using the Arize Skills

Add a TrueFoundry integration from your coding agent using the Arize Skills:

Create a custom model integration named 'my-truefoundry' with my base URL https://gateway.truefoundry.ai and API key tfy-...

Add the Integration from Arize AX

Select Custom Model Endpoints from the Providers List

The AI Provider integrations tab

Fill Out Your Integration Details

The TrueFoundry integration details pane
Give your integration a name (e.g. TrueFoundry). Then set your base URL and a TrueFoundry API token (a Personal Access Token or Virtual Account Token, created in the Access section of TrueFoundry).
Enter the base URL: https://gateway.truefoundry.ai. Do not include endpoint paths like /chat/completions as these are appended automatically.
If you need to send any extra headers to every request, set these. You then need to define the available model deployments. Leave OpenAI default models off and add your TrueFoundry model identifiers as custom model names. Models use a provider-account/model-name format (e.g. openai/gpt-4.1-mini), where the prefix is the name of the provider account configured in your TrueFoundry workspace. You can find the exact model ID, base URL, and a ready-to-use snippet in the Code Snippets tab of the TrueFoundry Playground.

Advanced Settings

The AI integration details tab
Expand the Advanced Settings section to configure the following:
  • Supports Function Calling - Turn this on to allow the integration to use function calling features. This is on by default.
  • Authorized Orgs - Configure which organizations have access to this integration.
  • Authorized Spaces - Configure which spaces have access to this integration.

Add the Integration

Finally check the box to agree to the terms and conditions, then select the Add Integration button to create the integration.