1. Arize AX
  2. Phoenix OSS
  3. Pricing
  4. Docs
  5. Learn
  6. Company
Book a demo Sign in Sign up

Blog

Filter
close Clear all

ServiceNow’s Tara Bogavelli on AgentArch: Benchmarking AI Agents for Enterprise Workflows

In our latest AI research paper reading, we hosted Tara Bogavelli, Machine Learning Engineer at ServiceNow, to discuss her team’s recent work on AgentArch, a new benchmark designed to evaluate…

3 minutes read
By Julian Reeves | 3 minutes read
LLM Evals Paper Readings Research

What Are the Top LLM Evaluation Tools?

AI agents and real-world applications of generative AI are debuting at an incredible clip this year, narrowing the time from AI research paper to industry application and propelling productivity growth…

1 minute read
By David Burch | 1 minute read
LLM Evals

Should I Use the Same LLM for My Eval as My Agent? Testing Self-Evaluation Bias

Thanks to Aparna Dhinakaran and Elizabeth Hutton for their contributions to this piece. When building and testing AI agents, one practical question that arises is whether to use the same…

9 minutes read
By Sanjana Yeddula | 9 minutes read
LLM Evals

Testing Binary vs Score Evals on the Latest Models

Thanks to Hamel Husain and Eugene Yan for reviewing this piece Evals are becoming the predominant approach for how AI engineers systematically evaluate the quality of the LLM generated outputs….

9 minutes read
By Aparna Dhinakaran | 9 minutes read
LLM Evals

AI Evals Maven Course Homework: the Recipe Bot Workflow

AI Evals for Engineers & PMs is a popular, hands‑on Maven course led by Hamel Husain and Shreya Shankar. The course’s goal is simple: “teach a systematic workflow for evaluating…

8 minutes read
By Sri Chavali | 8 minutes read
LLM Evals

How Handshake Deployed and Scaled 15+ LLM Use Cases In Under Six Months — With Evals From Day One

Handshake is the largest early-career network, specializing in connecting students and new grads with employers and career centers. It’s also an engineering powerhouse and innovator in applying AI to its…

3 minutes read
By Aparna Dhinakaran | 3 minutes read
Case Studies LLM Evals

Evidence-Based Prompting Strategies for LLM-as-a-Judge: Explanations and Chain-of-Thought

When LLMs are used as evaluators, two design choices often determine the quality and usefulness of their judgments: whether to require explanations for decisions, and whether to use explicit chain-of-thought…

7 minutes read
By Sri Chavali | 7 minutes read
LLM Evals
tracing cover art

Trace-Level LLM Evaluations with Arize AX

Most commonly, we hear about evaluating LLM applications at the span level. This involves checking whether a tool call succeeded, whether an LLM hallucinated, or whether a response matched expectations….

2 minutes read
By Sanjana Yeddula | 2 minutes read
LLM Evals
Load More

Subscribe to our resources and blogs

Subscribe