Large Language Models

How To Effectively Instrument Your LLM Application

LLM instrumentation is the process of monitoring and collecting data in an LLM application, helping you achieve performance and reliability.

This video covers key frameworks for instrumenting an LLM application -- including OpenTelemetry (Otel) and OpenInference -- and the tradeoffs between automatic and manual instrumentation. It also shows three ways to set up manual instrumentation: using decorators, the `with` clause, and starting spans directly.

🎛️ More on LLM instrumentation
🎛️ OpenInference
🎛️ LLM tracing quickstart

Subscribe to our resources and blogs

Subscribe