RAG Time! Evaluate RAG with LLM Evals and Benchmarking
2024-01-31 10:00 - 10:45 (America/Los_Angeles) | Virtual, United States

Community Paper Reading: RAG vs Fine-tuning
2024-02-07 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

Rocky Mountain AI Interest Group: The ABCs of GPTs
2024-02-07 18:30 - 20:30 (America/Los_Angeles) | CU Boulder

Evaluating LLMs: Needle in a Haystack
2024-02-13 17:30 - 20:30 (America/Los_Angeles) | San Francisco, United States
​LLM evaluation is a discipline where confusion reigns and foundation model builders are effectively grading their own homework.
​Building on the viral threads on X/Twitter, Greg Kamradt, Robert Nishihara, and Jason Lopatecki discuss highlights from Arize AI’s ongoing research on how major foundation models – from OpenAI’s GPT-4 to Mistral and Anthropic’s Claude – are stacking up against each other at important tasks and emerging LLM use cases, covering and explaining the importance of results of Needle in a Haystack tests and other evals results on hallucination detection on private data, question-and-answer, code functionality, and more.
​Curious which foundation models your company should be using for a specific use case – and which to avoid? You won’t want to miss this meetup!

Path to Production: LLM System Evaluations and Observability
2024-02-20 17:30 - 20:30 (America/Los_Angeles) | San Francisco, United States

Community Paper Reading: Exploring Sora & Evaluating Large Video Generation Models
2024-02-21 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

DevOps for GenAI Hackathon SF by MongoDB
2024-02-22 09:30 - 17:30 (America/Los_Angeles) | San Francisco, United States

Community Paper Reading: Reinforcement Learning in the Era of LLMs
2024-03-13 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

Community Paper Reading: Claude-3
2024-03-20 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

How to Read AI Research Papers Effectively
2024-03-21 10:00 - 11:00 (America/Los_Angeles) | Virtual, United States

Mistral AI SF Hackathon
2024-03-23 09:00 - 2024-03-24 17:00 (America/Los_Angeles) | Shack15

MLOPs World: Machine Learning in Production – San Francisco
2024-03-27 09:00 - 18:00 (America/Los_Angeles) | San Francisco, CA, San Francisco, CA, United States

Data Council Austin - Prepare for (Better) Extraction with Amber Roberts
2024-03-28 09:00 (America/Los_Angeles) | Austin, Texas, Austin, TX, United States

apply(conf)
2024-04-03 09:30 - 15:00 (America/Los_Angeles) | Virtual, United States

Community Paper Reading: Chronos – Learning the Language of Time Series
2024-04-03 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

LLM Evals in Practice: Introducing Evals for Advanced Pattern Analysis
2024-04-04 10:00 - 11:00 (America/Los_Angeles) | Virtual, United States

LLM Evals In Practice: How to Create Custom Task Evals
2024-04-11 10:00 - 11:00 (America/Los_Angeles) | Virtual, United States

MLOPs World Micro-summit: ML in Production / Generative AI Edition - NYC
2024-04-15 09:00 - 18:00 (America/Los_Angeles) | NYC

Epic AI Agents Summit: The Five Pillars for Successfully Observing LLM Apps in Production w/ Amber Roberts
2024-04-16 09:45 - 10:05 (America/Los_Angeles) | Virtual, United States
Epic

Analytics Frontiers Conference: Generating Responsible AI in the Age of LLMs with Amber Roberts
2024-04-16 15:10 - 15:55 (America/New_York) | Charlotte, NC

Advancing Open Source LLM Evaluation, Testing, and Debugging
2024-04-16 17:30 - 20:30 (America/Los_Angeles) | San Francisco, CA, San Francisco, CA, United States

Optimizing LLM Retrieval Strategies with Arize AI & Qdrant
2024-04-17 09:00 - 10:00 (America/Los_Angeles) | Virtual, United States

LLM Evals in Practice: Advanced Customer Feedback Analysis
2024-04-18 10:00 - 11:00 (America/Los_Angeles) | Virtual, United States

Community Paper Reading: ReAct
2024-04-24 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

ODSC East: Tracing in LLM Applications with Amber Roberts
2024-04-24 14:35 - 15:05 (America/New_York) | Boston, MA, United States

LLMs Beyond the Lab: Productionizing LLM-Powered Applications
2024-04-25 17:30 - 21:00 (America/Los_Angeles) | Seattle, WA

DSPy End-to-End
2024-05-01 17:30 - 20:30 (America/Los_Angeles) | San Francisco, United States

Gen AI Tools Infra & Open Source Demo Days
2024-05-08 - 2024-05-09 | Virtual, United States

Community Paper Reading: Who Validates and Validators?
2024-05-08 10:15 - 11:00 (America/Los_Angeles) | Virtual, United States

Path to Production: LLM System Evaluations and Observability
2024-05-09 08:30 - 17:00 (America/Los_Angeles) | Sunnyvale, CA
