Videos

Debugging Sessions in LLM Chatbot Applications with Tracing and Evals

A session is a grouping of traces based on a session ID attribute. When building or debugging an LLM chatbot application, being able to see groups of messages or traces belonging to a series of interactions between a human and the AI can be particularly helpful.

This tutorial covers how to add sessions and users as attributes to spans for LLM tracing to assist in finding where conversations break and groups of traces where an application is not performing well (i.e. LLM hallucinations). It also covers how to leverage LLM-assisted evaluations find best/worst performing sessions and users.

🔗 Docs: Sessions and Users
🔗 Notebook covering how to implement sessions in real-time

Subscribe to our resources and blogs

Subscribe