LLM instrumentation is the process of monitoring and collecting data in an LLM application, helping you achieve performance and reliability.
This video covers key frameworks for instrumenting an LLM application -- including OpenTelemetry (Otel) and OpenInference -- and the tradeoffs between automatic and manual instrumentation. It also shows three ways to set up manual instrumentation: using decorators, the `with` clause, and starting spans directly.
🎛️ More on LLM instrumentation
🎛️ OpenInference
🎛️ LLM tracing quickstart