-
AI EvaluationOrca: Progressive Learning from Complex Explanation Traces of GPT-4 Paper Reading
Introduction Recent research focuses on improving smaller models through imitation learning using outputs from large foundation models (LFMs). Challenges include limited imitation signals, homogeneous training data, and a… Sarah Welsh July 13, 2023 30 min read -
AI Evaluation
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning
Introduction In this week’s paper reading, we discuss “One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning.” GLoRA is a universal, parameter-efficient fine-tuning approach for diverse tasks. It enhances LoRA with… Sarah Welsh July 3, 2023 32 min read -
AI Evaluation
HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels
Introduction In this paper reading, we explore HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels. HyDE is a thrilling zero-shot learning technique that combines GPT-3’s language understanding with… Sarah Welsh June 27, 2023 30 min read -
AI Evaluation
LoRA: Low-Rank Adaptation of Large Language Models Paper Reading and Discussion
Introduction In this paper reading, we discuss LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly… Sarah Welsh June 12, 2023 28 min read -
AI Evaluation
Retrieval-Augmented Generation – Paper Reading and Discussion
Introduction In this paper reading, we discuss “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.” We know GPT-like LLMs are great at soaking up knowledge during pre-training and fine-tuning them… Sarah Welsh June 9, 2023 34 min read -
AI Evaluation
LIMA: Less Is More for Alignment – Paper Reading and Discussion
Introduction In this paper reading, we discuss “LIMA: Less Is More for Alignment.” This research delves into the efficiency and effectiveness of large language models, demonstrating the power… Sarah Welsh June 1, 2023 25 min read -
AI Evaluation
Drag Your GAN: Interactive Point-Based Manipulation on the Generative Image Manifold
Introduction In this paper reading, we dive into “Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold.” Drag Your GAN introduces a novel approach for achieving… Sarah Welsh June 1, 2023 23 min read -
AI EvaluationEvaluating Model Fairness
In many ways, bias and fairness in AI are two sides of the same coin; bias is a result, fairness is an action. Bias is inherently present in… Sally-Ann DeLucia May 17, 2023 10 min read -
AI EvaluationHungry Hungry Hippos (H3) and Language Modeling with State Space Models
Deep Papers, a Podcast from AI Pub and Arize AI Deep Papers is a podcast series featuring deep dives on today’s seminal AI papers and research. Hosted by… Jason Lopatecki March 29, 2023 18 min read -
AI EvaluationToolformer: Training LLMs To Use Tools
Deep Papers, a Podcast from AI Pub and Arize AI, Presents a Conversation with the Meta AI Research Scientists Behind Toolformer Deep Papers is a podcast series featuring… Jason Lopatecki March 21, 2023 17 min read -
AI EvaluationChatGPT and InstructGPT: Aligning Language Models to Human Intention
Introducing Deep Papers, a New Podcast from AI Pub and Arize AI Deep Papers is a new podcast series featuring deep dives on today’s seminal AI papers and… Jason Lopatecki January 19, 2023 1 min read
Don’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.
