Advanced LLM Evals: Creating an Eval from Scratch – Lessons from the Trenches with Bazaarvoice

Lou Kratz is Principal Research Engineer at Bazaarvoice, a service that is trusted by thousands of the world’s leading brands and retailers to drive revenue, extend reach, gain actionable insights, and create loyal advocates. Jason Lopatecki is CEO and Co-Founder of Arize AI In this session, Bazaarvoice will speak to their LLM use cases and share best practices around build LLM evals from scratch in partnership with Arize. This video is part two in a series on unpacking advanced LLM evaluation techniques and best practices formulated through rigorous testing — spanning retrieval, summarization, and hallucination — to help ensure production readiness. A must-attend for AI & ML engineers and data scientists.