Arize Phoenix now updates model prices automatically
Keep built-in model prices up to date with automatic catalog updates between Phoenix releases.
4 min read
Evil Qwen and activation steering: why SBOMs aren’t enough
A one-neuron push turns Qwen3.5-4B hostile. At half strength it still does the sums and writes code, and it stops refusing. SBOMs and model signing tell you what…
19 min read
I put a ghost in Claude Code. Then I evaluated it.
I built a Halloween Claude Code mod that grades each turn as a treat or a trick and blocks dangerous commands, then traced and evaluated it with Arize…
17 min readGet the latest on AI & Observability
Sign up for our newsletter, The Evaluator—and stay in the know with updates and new resources:
Catch up on everything you missed.
See all-
Agent EvaluationA web page talked our agent into leaking a stranger’s data. Here’s how we caught it.
A web page told our support agent to look up a different customer, and the agent complied on 28 of 100 runs. Here's how we found the leak… Nancy Chauhan October 26, 2026 15 min read -
Agent EngineeringHow to build a software factory that tests its own prompts
A small software factory that turns GitHub issues into released code, traces every station to Arize AX, and uses the verdicts it already produces to test and improve… Jim Bennett October 22, 2026 17 min read -
Agent EvaluationCan decision models play games from screenshots?
Decision models return a probability for each option in a fixed list. We tested whether image-capable decision models can play Tic-tac-toe, Minesweeper, and Flappy Bird from screenshots, and… Jim Bennett October 20, 2026 30 min read -
Agent EngineeringWhy Anthropic replaced Git, and whether you’ll need to
Anthropic built Scion for an enormous monorepo handling more than 30,000 daily merges. Most teams can keep using Git, but AI coding agents are changing how source control,… Laurie Voss October 19, 2026 11 min read -
Agent EvaluationAgent tool selection: The tool your agent almost called
Decision spans in Arize Phoenix record a tool router’s choice, alternative probabilities, and confidence. Here’s how we evaluated those decisions and used the results to set a fallback… Nancy Chauhan October 19, 2026 14 min read
Demos, workshops, and conference talks.
See all on YouTube
The Model Knew What to Say. The Harness Failed. | Laurie Voss
Laurie Voss (Head of Developer Relations at Arize AI) breaks down why the agent harness, specifically code-level guardrails, is the most critical boundary layer in modern software engineering.
InsightsDon’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.