LLM Observability: Evaluations – Part 1
2023-11-07 09:00 - 09:30 (America/Los_Angeles) | Virtual, United States

Community Paper Reading [ft. LLM Researcher Samuel Marks]: The Geometry of Truth: Emergent Linear Structure in LLM Representation of True/False Datasets
2023-11-08 10:15 - 11:00 | Virtual, United States

LLM Observability: Evaluations – Part 2
2023-11-14 09:00 - 09:30 | Virtual, United States

Devfest Silicon Valley 2023: AI Edition
2023-11-16 08:00 - 17:00 | Sunnyvale, CA

LLM Retrieval Evaluations: Advanced Techniques
2023-11-21 10:00 - 10:30 | Virtual, United States

How to Create an LLM Eval from Scratch: Lessons from the Trenches
2023-11-28 10:00 - 10:30 | Virtual, United States

Classes of LLM Evaluations: A Deep-Dive
2023-12-05 10:00 - 10:30 | Virtual, United States

Community Paper Reading [ft. LLM Researcher & author Shuaichen Chang] How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings
2023-12-06 13:00 - 13:45 | Virtual, United States

AGI House Hackathon: Optimize Your LLM Stack
2023-12-09 12:00 - 20:00 | AGI House

Dataset and Synthetic Data Generation for LLM Evaluations
2023-12-12 10:00 - 10:30 | Virtual, United States

Fine-Tuning and Evaluating LLM Retrieval Models with Anyscale and Arize
2023-12-13 17:30 - 20:30 | San Francisco, CA, San Francisco, CA, United States

AI For Developers
2023-12-14 18:00 - 20:00 | San Francisco, CA, San Francisco, CA, United States

Arize Holiday Special: 'Tis the Season of LLMs
2023-12-15 09:00 - 11:45 | Virtual, United States

Community Paper Reading: A Deep Dive Into Generative's Newest Models: Gemini vs Mistral (Mixtral-8x7B)
2023-12-20 10:15 - 11:00 | Virtual, United States

Community Paper Reading: A Deep Dive Into Generative's Newest Models: Gemini vs Mistral (Mixtral-8x7B) - Part Two
2024-01-10 10:15 - 11:00 | Virtual, United States

AI for Ukraine
2024-01-18 09:00 - 10:30 | Virtual, United States

Troubleshooting Large Language Models - an Interview with Amber Roberts
2024-01-19 09:00 - 10:00 | Virtual, United States

Community Paper Reading: Phi-2 – Small Language Models (SLMs) vs. LLMs
2024-01-24 10:15 - 11:00 | Virtual, United States

RAG Time! Evaluate RAG with LLM Evals and Benchmarking
2024-01-31 10:00 - 10:45 | Virtual, United States

Community Paper Reading: RAG vs Fine-tuning
2024-02-07 10:15 - 11:00 | Virtual, United States

Rocky Mountain AI Interest Group: The ABCs of GPTs
2024-02-07 18:30 - 20:30 | CU Boulder

Evaluating LLMs: Needle in a Haystack
2024-02-13 17:30 - 20:30 | San Francisco, United States
​LLM evaluation is a discipline where confusion reigns and foundation model builders are effectively grading their own homework.
​Building on the viral threads on X/Twitter, Greg Kamradt, Robert Nishihara, and Jason Lopatecki discuss highlights from Arize AI’s ongoing research on how major foundation models – from OpenAI’s GPT-4 to Mistral and Anthropic’s Claude – are stacking up against each other at important tasks and emerging LLM use cases, covering and explaining the importance of results of Needle in a Haystack tests and other evals results on hallucination detection on private data, question-and-answer, code functionality, and more.
​Curious which foundation models your company should be using for a specific use case – and which to avoid? You won’t want to miss this meetup!

Path to Production: LLM System Evaluations and Observability
2024-02-20 17:30 - 20:30 | San Francisco, United States

Community Paper Reading: Exploring Sora & Evaluating Large Video Generation Models
2024-02-21 10:15 - 11:00 | Virtual, United States

DevOps for GenAI Hackathon SF by MongoDB
2024-02-22 09:30 - 17:30 | San Francisco, United States

Community Paper Reading: Reinforcement Learning in the Era of LLMs
2024-03-13 10:15 - 11:00 | Virtual, United States

Community Paper Reading: Claude-3
2024-03-20 10:15 - 11:00 | Virtual, United States

How to Read AI Research Papers Effectively
2024-03-21 10:00 - 11:00 | Virtual, United States

Mistral AI SF Hackathon
2024-03-23 09:00 - 2024-03-24 17:00 | Shack15

MLOPs World: Machine Learning in Production – San Francisco
2024-03-27 09:00 - 18:00 | San Francisco, CA, San Francisco, CA, United States
