-
Open SourceEvals in CI: How to write your LLM evals as tests with Arize Phoenix
If you're struggling to get started with evals, you're not alone. This post explains how to write LLM evals as ordinary tests in CI with Phoenix, pytest, and… Mikyo King July 7, 2026 17 min read -
Open SourceProject Rosetta Stone: a reference implementation for instrumenting agents in any framework
We've fielded the same question at every conference this year. An engineer has chosen a framework, CrewAI one week, LangGraph the next, Mastra the week after, and wants… Jim Bennett June 22, 2026 6 min read -
Open SourceMeet PXI: the AI engineering agent inside Phoenix
An AI engineering agent built into Phoenix. It works like a coding agent, just point it at your telemetry instead of a source tree. Mikyo King Roger Yang Nancy Chauhan Anthony Powell June 18, 2026 17 min read -
Open SourcePhoenix at 10,000 stars on GitHub: How an open source AI observability project grew by following its community
Phoenix crossed 10,000 GitHub stars. Here is how the open-source AI observability project grew from a Jupyter notebook extension into a community-shaped platform for traces, evals, OpenInference, and… RL Nabors Nancy Chauhan June 7, 2026 10 min read -
Open SourceMicrosoft’s open trust stack runs on OpenInference
Microsoft's open trust stack for AI agents puts ASSERT and Agent Control Specification on top of OpenInference, connecting evaluation, runtime controls, and observability through a shared trace contract. Jim Bennett June 3, 2026 6 min read -
Open SourceHow Hermes implements an open source agent harness architecture
Hermes from NousResearch is a strong open-source agent harness. This post examines how its runtime loop, context management, tool scoping, session infrastructure, and orchestration patterns map to a… Aparna Dhinakaran June 1, 2026 7 min read -
Open SourceHow to build LLM-as-a-Judge evaluators that hold up in production
Learn how to design, calibrate, and run LLM-as-a-judge evaluators with fixed labels, human agreement checks, trace context, and Phoenix Evals. Aaron Winston May 21, 2026 22 min read -
Open SourceCoding agent tracing and evaluation: An open source tool to improve AI coding workflows
Announcing coding harness tracing for observing, evaluating, and improving coding agent workflows across Claude Code, Cursor, Codex, GitHub Copilot, and Gemini CLI. Duncan McKinnon Chris Cooning Fuad Ali May 18, 2026 5 min read -
Open SourceFrom observability to context: What’s next for Arize Phoenix
As agents start changing software, they need a way to verify their work that includes traces, evals, feedback, and APIs. This is where Phoenix goes next — not… Mikyo King Elizabeth Hutton May 11, 2026 10 min read -
Open SourceWhy agent telemetry needs standards
Enterprise agents are moving from demos into production workflows, which creates a basic problem: teams need to understand what those agents actually did. Richard Young May 1, 2026 6 min read -
Open SourceHow We Used Evals (and an AI Agent) to Iteratively Improve an AI Newsletter Generator
We love building little AI-powered tools that accelerate our workflows. One we built recently is a tool that takes our recent tweets and uses Claude to create a… Laurie Voss March 10, 2026 10 min read -
Open Source14 best AI agent observability tools in 2026: A practical comparison
Compare 14 AI agent observability tools for tracing, evaluations, OpenTelemetry, self-hosting, pricing, and production monitoring. Updated July 2026. Aryan Kargwal February 27, 2026 29 min read -
Open SourceAdd Observability to Your Open Agent Spec Agents with Arize Phoenix
Open Agent Specification lets you define an agent once and run it on any compatible runtime: LangGraph, WayFlow, CrewAI, and others. That portability solves a real problem in… Laurie Voss February 27, 2026 7 min read -
Open SourceHow America First Credit Union Built a GenAI “Decision Explainer” — With Tracing That Scales
America First Credit Union is one of America’s largest independent credit unions, with 1.5 million members and more than $20 billion worth of deposits. As America First Credit… Greg Chase February 19, 2026 3 min read -
Open SourceHow Observability-Driven Sandboxing Secures AI Agents
AI agents become dangerous at the moment they gain the ability to execute actions. The moment an agent can touch the file system or invoke external tools, safety… Aryan Kargwal January 22, 2026 11 min read
Don’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.
