Everything we’ve published.
-
Agent EvaluationIs the cheap model good enough? How to test a new model in your agent
A paper called GVS5H claims a cheap model in a manager/worker loop closes the gap to frontier models. I tested that against Opus 5.5 in my own agent,… Jim Bennett November 5, 2026 21 min read -
Open SourceArize Phoenix now updates model prices automatically
Keep built-in model prices up to date with automatic catalog updates between Phoenix releases. Nancy Chauhan November 2, 2026 4 min read -
LLM EvaluationEvil Qwen and activation steering: why SBOMs aren’t enough
A one-neuron push turns Qwen3.5-4B hostile. At half strength it still does the sums and writes code, and it stops refusing. SBOMs and model signing tell you what… Jim Bennett October 30, 2026 19 min read -
Agent EvaluationI put a ghost in Claude Code. Then I evaluated it.
I built a Halloween Claude Code mod that grades each turn as a treat or a trick and blocks dangerous commands, then traced and evaluated it with Arize… Jim Bennett October 27, 2026 17 min read -
Agent EvaluationA web page talked our agent into leaking a stranger’s data. Here’s how we caught it.
A web page told our support agent to look up a different customer, and the agent complied on 28 of 100 runs. Here's how we found the leak… Nancy Chauhan October 26, 2026 15 min read -
Agent EngineeringHow to build a software factory that tests its own prompts
A small software factory that turns GitHub issues into released code, traces every station to Arize AX, and uses the verdicts it already produces to test and improve… Jim Bennett October 22, 2026 17 min read -
Agent EvaluationCan decision models play games from screenshots?
Decision models return a probability for each option in a fixed list. We tested whether image-capable decision models can play Tic-tac-toe, Minesweeper, and Flappy Bird from screenshots, and… Jim Bennett October 20, 2026 30 min read -
Agent EngineeringWhy Anthropic replaced Git, and whether you’ll need to
Anthropic built Scion for an enormous monorepo handling more than 30,000 daily merges. Most teams can keep using Git, but AI coding agents are changing how source control,… Laurie Voss October 19, 2026 11 min read -
Agent EvaluationAgent tool selection: The tool your agent almost called
Decision spans in Arize Phoenix record a tool router’s choice, alternative probabilities, and confidence. Here’s how we evaluated those decisions and used the results to set a fallback… Nancy Chauhan October 19, 2026 14 min read -
Agent EngineeringAlyx now available on Google Cloud Marketplace
We’re excited to share that Alyx, the AI engineering agent built into Arize AX, is now available on Google Cloud Marketplace. Teams building and running AI agents on… Juston Western October 19, 2026 4 min read -
Agent EvaluationAI agent permissions: Why agents don’t know what you’re allowed to do
AI agent permissions determine what an agent is allowed to do on someone’s behalf. As agents get more powerful, we’re running into a basic problem: a model can’t… Laurie Voss October 15, 2026 8 min read -
Agent ObservabilityEU AI Act compliance for AI agents: a practical engineering guide
Learn how agent traces, human oversight, production evaluations, and log retention support EU AI Act compliance with a practical credit-assistant example. Jim Bennett October 13, 2026 15 min read -
AI EvaluationDoes being rude to AI work? What 6 models revealed
Does being rude to AI improve answers or lower costs? We tested six models to separate prompt tone from brevity instructions and examine what changes. Jim Bennett October 13, 2026 16 min read -
AI EngineeringTogether AI integration: Evaluate open models and optimize evaluation costs in Arize AX
Evaluate open models with Together AI in Arize AX. Compare model performance, run LLM-as-a-Judge evaluations, and explore lower-cost alternatives. Chris Cooning Lexi Pierre October 12, 2026 4 min read -
Agent EvaluationHow to test agent tool descriptions with Harbor and Phoenix
Build a reproducible benchmark, compare tool use across agents, and test whether a description change reduces unnecessary work while preserving outcomes. Nancy Chauhan October 12, 2026 11 min read
Don’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.