Arize Observe
The AI Agent Evaluation Conference
June 25, 2025
San Francisco — Shack15
The Era of AI Agents and Assistants
Thank you for joining the builders, researchers, and pioneering minds tackling AI’s most pressing challenge: ensuring results and reliability as systems grow more complex, powerful, and autonomous.
With AI agents making high-stakes decisions across industries, new frameworks to evaluate, monitor, and improve these systems have never been more critical.
Watch the Keynote
Top Sessions from Arize:Observe 2025
-
Pepsi & IBM
PepsiCo and IBM show how AI drives $92B enterprise scale, from custom Gatorade bottles to predictive shelves and forecasts.
Watch now -
OpenAI
An OpenAI engineer reveals what o3 playing Pokemon can teach us about memory, self-critique, multi-agent tools, and robust design.
Watch now -
Anthropic
Todd Underwood exposes AI Ops myths and envisions genuinely helpful AI agents in this candid, humorous talk on production engineering.
Watch now -
JPMorgan Chase
JPMorgan’s Brenda Ng builds a recommendation engine from merchant names, crafting a consumer knowledge graph with LLMs and credit data.
Watch now -
AWS
Amazon, showcase an agentic loan system, offering real-time traces and transparent AI underwriting decisions.
Watch now -
Letta
Letta’s CEO reveals stateful AI agents that learn, evolve, and persist using memory, async learning, and sleep-time compute.
Watch now -
Microsoft
Microsoft’s Rob Ferguson offers a framework to judge if your AI agent or chatbot can survive beyond its first traffic spike.
Watch now -
Mastra
Mastra CTO Abhi Aiyer demos a TypeScript-native framework for scalable AI agents, RAG pipelines, MCP servers, and orchestrated workflows.
Watch now -
Agents Panel
Leaders from A2G, LlamaIndex, Letta, CrewAI, Mastra, and Arize debated agent design, RAG, autonomy, and future frameworks.
Watch now
Key Speakers
Featured Speakers
See all speakersnull
Olivier Pomel
Co-founder & CEO
João Moura
CEO
Lukas Gross
Member of technical staff
Rahul Todkar
Head of Data and AI
Melody Meckfessel
CTO
Todd Underwood
Head of Reliability
Chi Wang
Founder of AutoGen, Google DeepMind
Greg Kamradt
President
Rajy Tanneeru
Distinguished AI & Data Architect
Aparna Dhinakaran
CPO and co-founder
Robert Nishihara
Co-Founder
Rodrigo Davies
AI Product Manager
Nachiket Karajagi
Global Sr. Director, Head of AI platforms & solutions
Jerry Liu
CEO & Co-Founder
James Emerson
Associate Director
Adrian Cole
Principle Engineer
research
Amir Gholami
University of California, Berkeley
Charles Packer
University of California, Berkeley
Kanishk Gandhi
Research Scientist
Nick Joseph Haber
Assistant Professor
null
Shobhit Varshney
Head of Data & AI, IBM Consulting
Taranjeet Singh
Head of Artificial Intelligence
Jay Rodge
Dev Advocate
Sherwood Callaway
Software Engineer & AI Agent Expert
Vivek Gangasani
Sr. GenAI Specialist Solutions Architect
Anu Trivedi
Head of GenAI
Alex Casella
Co-Founder, Head of Engineering
Haoqin Tu
University of California, Santa Cruz
