Author
John Gilhuly
John Gilhuly is an AI Engineer and developer advocate at Arize AI, a leading platform for AI observability and LLM evaluation. Previously, Gilhuly held technical roles at Branch and Slingshot AI. He has an MBA from Stanford University and studied Computer Science at Duke University.
Recent posts
-
AI EvaluationEvaluating an Image Classifier
Phoenix supports multi-modal evaluation and tracing. In this tutorial, we’ll take advantage of that to walk through the process of setting up an image classification experiment using Phoenix.… John Gilhuly August 30, 2024 5 min read -
AI ObservabilityTrace Your Haystack Application
Haystack is an open-source framework for building LLM applications, retrieval-augmented generative pipelines and search systems that work intelligently over large document collections. Haystack makes it very easy to… John Gilhuly August 19, 2024 4 min read -
LLM EvaluationHow To Use Annotations To Collect Human Feedback On Your LLM Application
Liking Phoenix? Please consider giving us a ⭐ on Github! Cast your mind back to the early days of mainstream AI development – a whopping seven years ago.… John Gilhuly August 15, 2024 4 min read -
Agent EngineeringLlamaIndex Workflows: Navigating a New Way To Build Cyclical Agents
Last week, LlamaIndex released Workflows, a new approach to easily create agents. Workflows use an event-based architecture instead of the directed acyclic graph approach used by traditional pipelines… John Gilhuly August 8, 2024 6 min read -
LLM EvalsLLM Function Calling: Evaluating Tool Calls In LLM Pipelines
Function calling is an essential part of any AI engineer’s toolkit, enabling builders to enhance a model’s utility at specific tasks. As more LLM applications leveraging tool calls… John Gilhuly July 16, 2024 2 min read
Don’t ship vibes.
Arize gives AI teams observability and evals to understand and improve agent performance.
