Author

Evan Jolley

Recent posts

AI Observability

Instrumenting Your LLM Application: Arize Phoenix and Vercel AI SDK

Instrumentation is an important tool for developers building with LLMs. It provides insight into application performance, behavior, and impact. This blog will cover: Why instrumentation matters for LLM… Evan Jolley November 19, 2024 5 min read
LLM Evals

Creating and Validating Synthetic Datasets for LLM Evaluation & Experimentation

Thanks to John Gilhuly for his contributions to this piece. Looking for more on generating synthetic data and data evaluation? Book time with an Arize team member to… Evan Jolley September 5, 2024 6 min read
LLM As A Judge

Text To SQL: Evaluating SQL Generation with LLM as a Judge

Special shoutout to Manas Singh for collaborating with us on this research! One application of LLMs that has garnered headlines and significant investment surrounds their ability to generate… Aparna Dhinakaran Evan Jolley August 1, 2024 4 min read
AI Observability

Different Ways to Instrument Your LLM Application

Thanks to John Gilhuly for his contributions to this piece LLM instrumentation is the process of monitoring and collecting data in an LLM application, and it plays an… Evan Jolley July 25, 2024 6 min read
AI Observability

LlamaIndex’s Newly-Released Instrumentation Module + Phoenix Integration

Due to the black box nature of LLMs and the importance of tasks they’re being trusted to handle, intelligent monitoring and optimization tools are essential to ensure they… Evan Jolley July 1, 2024 7 min read

Don’t ship vibes.

Arize gives AI teams observability and evals to understand and improve agent performance.

Get started Book a demo