VertexAI Tracing

The VertexAI SDK can be instrumented using the openinference-instrumentation-vertexai package.

Install

pip install openinference-instrumentation-vertexai vertexai

Setup

See Google’s guide on setting up your environment for the Google Cloud AI Platform. You can also store your Project ID in the CLOUD_ML_PROJECT_ID environment variable. Connect your application to Phoenix with the register function:

Run VertexAI

import vertexai
from vertexai.generative_models import GenerativeModel

vertexai.init(location="us-central1")
model = GenerativeModel("gemini-1.5-flash")

print(model.generate_content("Why is sky blue?").text)

Observe

Now that you have tracing setup, all invocations of Vertex models will be streamed to your running Phoenix for observability and evaluation.

Resources

Example notebook
OpenInference package
Working examples

Overview Overview

⌘I

Developer Tools

MCP

LLM Providers

TypeScript

Python

Java

Platform

Sandboxes

Evaluation Integrations

Coding Agents

VertexAI Tracing

Install

Setup

Run VertexAI

Observe

Resources

​Install

​Setup

​Run VertexAI

​Observe

​Resources

Install

Setup

Run VertexAI

Observe

Resources