Novita AI Tracing

Novita AI provides model APIs with OpenAI-compatible chat completions support. Point the OpenAI client at Novita AI’s OpenAI-compatible endpoint and use openinference-instrumentation-openai to send traces to Phoenix.

This page uses Novita AI’s OpenAI-compatible API. There is no separate Novita-specific OpenInference instrumentor required.

Install

pip install arize-phoenix-otel openinference-instrumentation-openai openai

Setup

Add your Novita AI API key and the model you want to call as environment variables:

export NOVITA_API_KEY="<your-novita-api-key>"
export NOVITA_MODEL="<your-novita-model-id>"

Connect your application to Phoenix with the register function:

Run Novita AI

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.novita.ai/openai",
    api_key=os.environ["NOVITA_API_KEY"],
)

response = client.chat.completions.create(
    model=os.environ["NOVITA_MODEL"],
    messages=[
        {
            "role": "user",
            "content": "What should teams inspect when an LLM answer is wrong?",
        },
    ],
)

print(response.choices[0].message.content)

Observe

Now that you have tracing set up, all invocations of the OpenAI client pointed at Novita AI will be streamed to your running Phoenix for observability and evaluation. Each call appears as a ChatCompletion LLM span with the prompt, response, model name, token usage, and latency.

Common Issues

Spans missing: register(..., auto_instrument=True) must run before your application sends requests, and openinference-instrumentation-openai must be installed in the same environment
401 from Novita AI: Use your Novita AI API key, not an OpenAI key
Model not found: Confirm NOVITA_MODEL matches a model identifier available in your Novita AI account
Base URL: Ensure you’re using https://api.novita.ai/openai as the base URL

Developer Tools

LLM Providers

TypeScript

Python

Java

.NET

Platform

Vector Databases

Sandboxes

Evaluation Integrations

Coding Agents

Novita AI Tracing

Install

Setup

Run Novita AI

Observe

Common Issues

Resources

Novita AI LLM API

OpenInference OpenAI Instrumentation

​Install

​Setup

​Run Novita AI

​Observe

​Common Issues

​Resources

Novita AI LLM API

OpenInference OpenAI Instrumentation

Install

Setup

Run Novita AI

Observe

Common Issues

Resources