Skip to main content

Google Colab

colab.research.google.com
Amazon Bedrock Agents allow you to easily define, deploy, and manage agents on your AWS infrastructure. Traces on invocations of these agents can be captured using OpenInference and viewed in Phoenix. This instrumentation will capture data on LLM calls, action group invocations (as tools), knowledgebase lookups, and more.

Install

Setup

Connect your application to Phoenix with the register function: After connecting to your Phoenix server, instrument boto3 prior to initializing a bedrock-runtime client. All clients created after instrumentation will send traces on all calls to invoke_model, invoke_agent, and their streaming variations.

Run Bedrock Agents

From here you can run Bedrock as normal

Observe

Now that you have tracing setup, all calls will be streamed to your running Phoenix for observability and evaluation.

Bedrock Traces in Phoenix

Resources