The AI Observability & LLM Evaluation Event

You don’t want to miss this year’s premier event for LLM evaluation and observability, now open for speaker and sponsor proposals. BART, Uber, or fly in for the latest cutting-edge research, real-world insights from AI engineers, and useful workshops to evaluate and troubleshoot AI in production.

Can LLM evals make the accelerationist dream a sustainable reality? Is RAG becoming a drag? Which foundation models are winning the horse race for specific use cases? Hear answers from some of the top minds in the space to the big questions (and ask your own)!

July 11, 2024 | San Francisco

DAYS
HR
MIN
SEC

July 11, 2024|Shack15 in San Francisco|July 11, 2024|Shack15 in San Francisco |July 11, 2024

July 11|Shack15 in San Francisco

Join us at SHACK15

Join AI practitioners, researchers, and technology leaders for an unforgettable face-to-face gathering in San Francisco to connect, learn, and innovate together.

Submit a Talk

AGENDA

THE AI OBSERVABILITY & EVALUATION EVENT

TRACK ONE

AI Builders' Guild

AI Builders’ Guild

Development, application, and impact of innovative tools and evaluation methodologies in AI observability. Hands-on sessions provide pragmatic experience on evaluating and measuring the performance and reliability of AI systems using the latest open-source tools available.

TRACK TWO

AI Research Frontiers

AI Research Frontiers

Cutting-edge research, emerging techniques, and theoretical advancements in AI observability and LLM evaluation. Explore the latest findings and methodologies pushing the boundaries of what’s possible in understanding, evaluating, and improving AI-powered systems.

TRACK THREE

AI Innovators

AI Innovators

Explore the real world use cases, challenges in deploying products, and scaling of AI across organizations. AI leaders share learnings on industry-specific considerations to navigate the complexities of enterprise AI deployment.

Session details coming soon

Event Sponsors

Become a Partner

Previous speakers

  • Anyscale
  • Anyscale