AI Research Papers

Dive into the latest technical papers with the Arize Community.
Sign up to join us for bi-weekly AI research paper readings.

Article

The Definitive Guide to LLM Evaluation

A structured approach to building, implementing, and optimizing evaluation strategies for LLM applications.

Read

Video course

Deeplearning course: Evaluating AI Agents

Learn how to systematically assess and improve your AI agent’s performance in Evaluating AI Agents, a DeepLearning course.

Watch

Podcast series

Deep Papers is a podcast series since 2023 featuring deep dives on today’s most important AI papers and research.

Listen

Featured

AI Benchmark Deep Dive: Gemini 2.5 and Humanity’s Last Exam

A comprehensive overview of modern AI benchmarks, taking a close look at Google’s recent Gemini 2.5 release and its performance on key evaluations

LibreEval: A Smarter Way to Detect LLM Hallucinations

The Arize team has generated the largest public dataset of hallucinations, as well as a series of fine-tuned evaluation models.

Research posts

Recommended resources

AI Agent Workflows and Architectures Masterclass

Merge, Ensemble, and Cooperate! A Survey on Collaborative LLM Strategies

Build More Accurate AI Apps Through Fast Experimentation with Arize Phoenix, Langflow, and NVIDIA

Start your AI observability journey.

Book a demo Get started

AI Research Papers

Dive into the latest technical papers with the Arize Community. Sign up to join us for bi-weekly AI research paper readings.

The Definitive Guide to LLM Evaluation

Deeplearning course: Evaluating AI Agents

Featured

AI Benchmark Deep Dive: Gemini 2.5 and Humanity’s Last Exam

LibreEval: A Smarter Way to Detect LLM Hallucinations

Research posts

Merge, Ensemble, and Cooperate! A Survey on Collaborative LLM Strategies

Agent-as-a-Judge: Evaluate Agents with Agents

Introduction to OpenAI’s Realtime API

Model Context Protocol

How DeepSeek is Pushing the Boundaries of AI Development

Multiagent Finetuning: A Conversation with Researcher Yilun Du

Swarm: OpenAI’s Experimental Approach to Multi-Agent Systems

Breaking Down Reflection Tuning: Enhancing LLM Performance with Self-Learning

Composable Interventions for Language Models

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges

Extending the Context Window of LLaMA Models Paper Reading

DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines

RAFT: Adapting Language Model to Domain Specific RAG

LLM Interpretability and Sparse Autoencoders: Research from OpenAI and Anthropic

Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment

Breaking Down EvalGen: Who Validates the Validators?

Keys To Understanding ReAct: Synergizing Reasoning and Acting in Language Models

Demystifying Amazon’s Chronos: Learning the Language of Time Series

Anthropic Claude 3

Reinforcement Learning in the Era of LLMs

Sora: OpenAI’s Text-to-Video Generation Model

Phi-2 Model

Mistral AI (Mixtral-8x7B): Performance, Benchmarks

How to Prompt LLMs for Text-to-SQL

The Geometry of Truth: Emergent Linear Structure in LLM Representation of True/False Datasets

Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models

Explaining Grokking Through Circuit Efficiency

Large Content And Behavior Models to Understand, Simulate, and Optimize Content and Behavior.

Skeleton of Thought: LLMs Can Do Parallel Decoding Paper Reading

Extending the Context Window of LLaMA Models Paper Reading

Llama 2: Open Foundation and Fine-Tuned Chat Models Paper Reading

Lost in the Middle: How Language Models Use Long Contexts Paper Reading

Orca: Progressive Learning from Complex Explanation Traces of GPT-4 Paper Reading

One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning

HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels

Voyager: An Open-Ended Embodied Agent with LLMs Paper Reading and Discussion

Retrieval-Augmented Generation – Paper Reading and Discussion

LoRA: Low-Rank Adaptation of Large Language Models Paper Reading and Discussion

Drag Your GAN: Interactive Point-Based Manipulation on the Generative Image Manifold

LIMA: Less Is More for Alignment – Paper Reading and Discussion

Hungry Hungry Hippos (H3) and Language Modeling with State Space Models

Toolformer: Training LLMs To Use Tools

OpenAI on Reinforcement Learning With Human Feedback (RLHF)

Recommended resources

AI Agent Workflows and Architectures Masterclass

Merge, Ensemble, and Cooperate! A Survey on Collaborative LLM Strategies

Build More Accurate AI Apps Through Fast Experimentation with Arize Phoenix, Langflow, and NVIDIA

Start your AI observability journey.

Subscribe to The Evaluator

Dive into the latest technical papers with the Arize Community.
Sign up to join us for bi-weekly AI research paper readings.