> ## Documentation Index
> Fetch the complete documentation index at: https://arize-ax.mintlify.site/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# LiteLLM

> Integrate with LiteLLM as an AI Provider

Use models from your [LiteLLM](https://docs.litellm.ai/) proxy in the prompt playground and evals.

<Note>
  By adding this integration, your data may be sent through your LiteLLM deployment to the underlying model provider for certain actions within Arize AX (e.g., prompt playground) and your account may be billed for usage.
</Note>

## Add the Integration Using the Arize Skills

Add a LiteLLM integration from your coding agent using the [Arize Skills](/docs/ax/skills/overview):

<Prompt description="Create a LiteLLM integration named 'my-litellm' with my proxy URL and key sk-...">
  Create a LiteLLM integration named 'my-litellm' with my proxy URL and key sk-...
</Prompt>

## Add the Integration from Arize AX

### Select LiteLLM from the Providers List

**Navigate to Settings -> [AI Providers](https://app.arize.com/account/ai-providers)** and select **LiteLLM**.

<Frame caption="The AI Provider integrations tab">
  <img src="https://mintcdn.com/arize-ax/cnfQhqEMQchU2d80/images/ai-providers/ai-integration-providers-litellm.webp?fit=max&auto=format&n=cnfQhqEMQchU2d80&q=85&s=38250f251a8f707f9e6df6bb7e9a0da1" alt="The AI Provider integrations tab with the LiteLLM tile in the Get Started grid" width="2000" height="1096" data-path="images/ai-providers/ai-integration-providers-litellm.webp" />
</Frame>

### Fill Out Your Integration Details

<Frame caption="The LiteLLM integration configuration pane">
  <img src="https://mintcdn.com/arize-ax/cnfQhqEMQchU2d80/images/ai-providers/ai-integration-providers-litellm-details.webp?fit=max&auto=format&n=cnfQhqEMQchU2d80&q=85&s=5e04677d3dadbaa90355938d6ebd1bfd" alt="The LiteLLM integration details pane with name, API key, API base URL, extra headers, custom models, and test integration fields" width="2000" height="1140" data-path="images/ai-providers/ai-integration-providers-litellm-details.webp" />
</Frame>

Enter a name, your **API Key** (a [LiteLLM virtual key](https://docs.litellm.ai/docs/proxy/virtual_keys)), and the **API Base URL** of your LiteLLM deployment, without `/chat/completions`.

### Advanced Settings

<Frame caption="The Advanced Settings configuration pane">
  ![The AI integration details tab](https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/ai-integration-providers-advanced-settings.png)
</Frame>

Expand the **Advanced Settings** section to configure the following:

* **Supports Function Calling** - Turn this on to allow the integration to use function calling features. This is on by default.
* **Authorized Orgs** - Configure which organizations have access to this integration.
* **Authorized Spaces** - Configure which spaces have access to this integration.

## Add the Integration

Finally check the box to agree to the terms and conditions, then select the **Add Integration** button to create the integration.