Arize Release Notes: Aug 23, 2024

Welcome to our regular update on new releases, enhancements, and changes. What’s New Create Spaces Programmatically Users can now create spaces programmatically with graphQL. Online Evals Update We added support for three new LLM integrations for online tasks: Azure OpenAI, Bedrock, and Vertex / Gemini. Event-Based Snowflake Jobs Users can now trigger Snowflake queries using...

David Burch August 2024 1 min read

Welcome to our regular update on new releases, enhancements, and changes.

What’s New

Create Spaces Programmatically

Users can now create spaces programmatically with graphQL.

Online Evals Update

We added support for three new LLM integrations for online tasks: Azure OpenAI, Bedrock, and Vertex / Gemini.

Event-Based Snowflake Jobs

Users can now trigger Snowflake queries using graphQL.

Enhancements

Python SDK v7.20.1

Enable delayed tags for stream logging
Experiment eval metadata
Ingest data to Arize using space_id

Learn about Python SDK fixes and improvements here.

📚 New Content

🪡 How To Trace Your Haystack LLM App
🦙 LlamaIndex Workflows: Navigating a New Way To Build Cyclical Agents
🚧 Types of LLM Guardrails
✋ How To Use Annotations for Human Feedback
🧑🏽‍⚖️ Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
🦙 Breaking Down Llama 3
✨ How Flipkart Leverages Generative AI for 600 Million Users
🏥 Atropos Health: Leveraging LLM Observability

Get the latest on AI & Observability

Sign up for our newsletter, The Evaluator—and stay in the know with updates and new resources:

Related articles

Keep building the quality bar.

See all

Agent Engineering

Agent cost management is about more than the model

Every LLM call your application makes costs money, and agentic applications make a lot of LLM calls. Arize AX now ships a Cost Agent that reads traces, ranks…

Agent Engineering

How Uber evaluates AI agents at production scale

A background comment about pizza exposed a failure that Uber’s offline evaluations had missed. The incident helped reveal what production AI agent evaluation actually requires: automatic tracing, living…

Agent Engineering

Evaluation-driven development: How to move AI agents from pilot to production

Learn how evaluation-driven development, agent harnesses, AI observability, guardrails, and cost-per-outcome metrics move AI agents from pilot to production.

Don’t ship vibes.

Arize gives AI teams observability and evals to understand and improve agent performance.

Get started Book a demo