Synthetic Data Generation
Amber Roberts is a data scientist and machine learning engineer at Arize AI and leads the company's learning and development efforts. This video is part four in a series on unpacking advanced LLM evaluation techniques and best practices formulated through rigorous testing — spanning retrieval, summarization, and hallucination — to help ensure production readiness. A must-attend for AI & ML engineers and data scientists. This session covers classes of LLM evaluations.
See the rest of the series and sign up for future events:
https://arize.com/advanced-llm-evaluation
Learn more about LLM evaluation:
https://arize.com/blog-course/llm-evaluation-the-definitive-guide/
Recommended resources
LLM Evaluation: Everything You Need To Run, Benchmark LLM Evals
This piece is co-authored by senior machine learning engineer Ilya Reznik Large language models (LLMs) are an incredible…
Start the course
The Definitive LLM Observability Checklist
According to a recent survey, only 30.1% of teams deploying LLMs have implemented observability despite large majorities wanting…
Read more
LLM Observability: One Small Step for Spans, One Giant Leap for Span-Kinds
Troubleshooting Generative AI Models in Production As AI teams navigate the best practices for implementing large language models…
Start the course