Sarah Welsh
-
AI Product QualityRAG vs Fine-Tuning
Introduction This week we discussed “RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture.” This paper that explores a pipeline for Fine-tuning and RAG, and presents… Sarah Welsh February 8, 2024 31 min read -
AI EvaluationPhi-2 Model
Introduction With only 2.7 billion parameters, Phi-2 surpasses the performance of Mistral and Llama-2 models at 7B and 13B parameters on various aggregated benchmarks. Notably, it achieves better… Sarah Welsh January 31, 2024 36 min read -
AI ObservabilityTop AI Conferences of 2024: Generative AI and Beyond
Psst…Looking for 2025 conferences? Click here. As we prepare for another remarkable year in artificial intelligence, the importance of keeping up with the latest advancements, trends, and breakthroughs… Sarah Welsh January 10, 2024 23 min read -
AI EvaluationMistral AI (Mixtral-8x7B): Performance, Benchmarks
Introduction For the last paper read of the year, Arize CPO & Co-Founder, Aparna Dhinakaran, is joined by a Dat Ngo (ML Solutions Architect) and Aman Khan (Group… Sarah Welsh December 27, 2023 35 min read -
Prompt EngineeringHow to Prompt LLMs for Text-to-SQL
Introduction For this paper read, we’re joined by Shuaichen Chang, now an Applied Scientist at AWS AI Lab and author of this week’s paper to discuss his findings.… Sarah Welsh December 18, 2023 28 min read -
AI EngineeringThe Geometry of Truth: Emergent Linear Structure in LLM Representation of True/False Datasets
Introduction For this paper read, we’re joined by Samuel Marks, Postdoctoral Research Associate at Northeastern University, to discuss his paper, “The Geometry of Truth: Emergent Linear Structure in… Sarah Welsh November 14, 2023 32 min read -
AI EngineeringTowards Monosemanticity: Decomposing Language Models With Dictionary Learning
Introduction In this paper read, we discuss “Towards Monosemanticity: Decomposing Language Models With Dictionary Learning,” a paper from Anthropic that addresses the challenge of understanding the inner workings… Sarah Welsh November 2, 2023 26 min read -
Open SourceRankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models
Introduction In this paper reading, we’ll be discussing RankVicuna, the first fully open-source LLM capable of performing high-quality listwise reranking in a zero-shot setting. While researchers have successfully… Sarah Welsh October 17, 2023 32 min read -
AI EngineeringExplaining Grokking Through Circuit Efficiency
Introduction Join Arize Co-Founder & CEO Jason Lopatecki, and ML Solutions Engineer, Sally-Ann DeLucia, as they discuss “Explaining Grokking Through Circuit Efficiency.” This paper explores novel predictions about… Sarah Welsh October 6, 2023 27 min read -
AI EngineeringLarge Content And Behavior Models to Understand, Simulate, and Optimize Content and Behavior.
Introduction Amber Roberts and Sally-Ann DeLucia discuss “Large Content And Behavior Models To Understand, Simulate, And Optimize Content And Behavior.” This paper highlights that while LLMs have great… Sarah Welsh September 18, 2023 36 min read
Don’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.