🤖 Sign Up for the AI Agent Mastery Bootcamp →

AI Research Paper Readings

Delve into the latest technical papers with the Arize Community.

📚 Sign up for bi-weekly AI research paper readings

Aman Khan and John Gilhuly screenshot from talk
Exploring OpenAI's o1-preview and o1-mini
Video
Dat Ngo and X screenshot from paper reading
Breaking Down Reflection Tuning: Enhancing LLM Performance with Self-Learning
Video
Practical interventions should be order invariant and not regress overall perf
Composable Interventions for Language Models
Video
Julia Gomes looking at LLM judges slide from paper reading
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
Video
Pre-training benchmarks from Llama 3 paper
Breaking Down Meta's Llama 3 Herd of Models
Video
Sally-Ann, Dat Ngo, and Cyrus Nouroozi image from talk
DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines
Video
RAFT is a training procedure for open book question answering
RAFT: Adapting Language Model to Domain Specific RAG
Video
Experiment details: use of sparse auto encoders
LLM Interpretability and Sparse Autoencoders: Research from OpenAI and Anthropic
Video
Amber and SallyAnn discussing trustworthy LLMs paper
Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment
Video
Breaking Down EvalGen
Breaking Down EvalGen: Who Validates the Validators?
Video
Results - Decision Making
Keys To Understanding ReAct: Synergizing Reasoning and Acting in Language Models
Video
Chronos framework: Time series tokenization, training, and inference chart
Demystifying Chronos: Learning the Language of Time Series
Video
SallyAnn Delucia and Aman Khan
Anthropic Claude 3
Video
Reinforcement Learning Overview Slide
Reinforcement Learning in the Era of LLMs
Video
Vibhu Sapra reviewing the technical report on Sora
Sora: Open AI's Text to Video Generation Model
Video
SallyAnn DeLucia and Aman Khan talking about Phi-2
Phi-2 Model
Video
Mixtral of experts chart from blog
Mistral AI (Mixtral-8x7B): Performance, Benchmarks
Video
Image of Amber Roberts and Shuaichen Chang talking
How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings
Video
Sally-Ann DeLucia and Samuel Marks
The Geometry of Truth: Emergent Linear Structure in LLM Representation of True/False Datasets
Video
What is Monosemanticity slide
Towards Monosemanticity: Decomposing Language Models With Dictionary Learning
Video
Amber Roberts and Claire Longo discussing RankVicuna
Zero-Shot Listwise Document Reranking with Open-Source Large Language Models
Video
SallyAnn DeLucia and Grokking Paper
Explaining Grokking Through Circuit Efficiency
Video
Large Content and Behavior Models To Understand, Simulate, And Optimize Content And Behavior Paper Reading
Video
Skeleton of Thought methods walkthrough
Skeleton of Thought: LLMs Can Do Parallel Decoding Paper Reading
Video
Extending the Context Window of Llama Models paper
Extending the Context Window of LLaMA Models
Video
Violation percentage chart Llama 2
Llama 2: Open Foundation and Fine-Tuned Chat Models
Video
Lost in the middle paper reading zoom screenshot
Lost in the Middle: How Language Models Use Long Contexts Paper Reading
Video
Orca Graph
Orca: Progressive Learning from Complex Explanation Traces of GPT-4 Paper Reading
Video
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning Paper Reading
Video
HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels
Video
Voyager: An Open-Ended Embodied Agent with LLMs Paper
Video
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks Paper
Video
explain neurons easy explanation of openai paper
Language Models Can Explain Neurons in Language Models OpenAI Paper
Video
LoRA: Low-Rank Adaptation of Large Language Models Paper
Video
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold Paper
Video
LIMA: Less Is More for Alignment Paper
Video
h3 author interview
Hungry Hungry Hippos (H3) and Language Modeling with State Space Models
Video
meta toolformer interview
Toolformer: Training LLMs To Use Tools
Video
OpenAI on Reinforcement Learning with Human Feedback
OpenAI: Reinforcement Learning with Human Feedback
Video

Recommended Resources

Introduction To Retrieval Augmented Generation

Introduction To Retrieval Augmented Generation

Guardrails: What Are They and How Can You Use NeMo and Guardrails AI To Safeguard LLMs?

Guardrails: What Are They and How Can You Use NeMo and Guardrails AI To Safeguard LLMs?

LLM Agents: How To Set Up

LLM Agents: How To Set Up

A Developer’s Guide To LLMOps (Large Language Model Operations): Operationalizing LLMs

A Developer’s Guide To LLMOps (Large Language Model Operations): Operationalizing LLMs

How To Use LangChain With Monitoring To Fine-Tune Your LLM Applications

How To Use LangChain With Monitoring To Fine-Tune Your LLM Applications

The Definitive Machine Learning Observability Checklist

Whitepapers

The Definitive Machine Learning Observability Checklist

Embeddings: Meaning, Examples and How To Compute

Embeddings: Meaning, Examples and How To Compute

LLM Search & Retrieval Systems with Arize and LlamaIndex: Powering LLMs on Your Proprietary Data

Workshop

LLM Search & Retrieval Systems with Arize and LlamaIndex: Powering LLMs on Your Proprietary Data

Sign up for our monthly newsletter, The Evaluator.

Sign up now

Copyright © 2024 Arize AI, Inc