Arize Observe
The AI Agent Evaluation Conference
June 25, 2025
San Francisco — Shack15
The Era of AI Agents and Assistants
Thank you for joining the builders, researchers, and pioneering minds tackling AI’s most pressing challenge: ensuring results and reliability as systems grow more complex, powerful, and autonomous.
With AI agents making high-stakes decisions across industries, new frameworks to evaluate, monitor, and improve these systems have never been more critical.
Watch the Keynote
Thank you for making Arize:Observe a success!





Top Sessions from Arize:Observe 2025
-
Pepsi & IBM
PepsiCo and IBM show how AI drives $92B enterprise scale, from custom Gatorade bottles to predictive shelves and forecasts.
Watch now -
OpenAI
An OpenAI engineer reveals what o3 playing Pokemon can teach us about memory, self-critique, multi-agent tools, and robust design.
Watch now -
Anthropic
Todd Underwood exposes AI Ops myths and envisions genuinely helpful AI agents in this candid, humorous talk on production engineering.
Watch now -
JPMorgan Chase
JPMorgan’s Brenda Ng builds a recommendation engine from merchant names, crafting a consumer knowledge graph with LLMs and credit data.
Watch now -
AWS
Amazon, showcase an agentic loan system, offering real-time traces and transparent AI underwriting decisions.
Watch now -
Letta
Letta’s CEO reveals stateful AI agents that learn, evolve, and persist using memory, async learning, and sleep-time compute.
Watch now -
Microsoft
Microsoft’s Rob Ferguson offers a framework to judge if your AI agent or chatbot can survive beyond its first traffic spike.
Watch now -
Mastra
Mastra CTO Abhi Aiyer demos a TypeScript-native framework for scalable AI agents, RAG pipelines, MCP servers, and orchestrated workflows.
Watch now -
Agents Panel
Leaders from A2G, LlamaIndex, Letta, CrewAI, Mastra, and Arize debated agent design, RAG, autonomy, and future frameworks.
Watch now
Key Speakers
Featured Speakers
See all speakersnull

Olivier Pomel
Co-founder & CEO


João Moura
CEO


Lukas Gross
Member of technical staff


Rahul Todkar
Head of Data and AI


Melody Meckfessel
CTO


Todd Underwood
Head of Reliability


Chi Wang
Founder of AutoGen, Google DeepMind


Greg Kamradt
President


Rajy Tanneeru
Distinguished AI & Data Architect


Aparna Dhinakaran
CPO and co-founder


Robert Nishihara
Co-Founder


Rodrigo Davies
AI Product Manager


Nachiket Karajagi
Global Sr. Director, Head of AI platforms & solutions


Jerry Liu
CEO & Co-Founder


James Emerson
Associate Director


Adrian Cole
Principle Engineer

research

Amir Gholami
University of California, Berkeley


Charles Packer
University of California, Berkeley


Kanishk Gandhi
Research Scientist


Nick Joseph Haber
Assistant Professor

null

Shobhit Varshney
Head of Data & AI, IBM Consulting


Taranjeet Singh
Head of Artificial Intelligence


Jay Rodge
Dev Advocate


Sherwood Callaway
Software Engineer & AI Agent Expert

Vivek Gangasani
Sr. GenAI Specialist Solutions Architect


Anu Trivedi
Head of GenAI


Alex Casella
Co-Founder, Head of Engineering


Haoqin Tu
University of California, Santa Cruz
