Skip to main content

Overview

OpenLIT an open-source observability package for LLM applications that provides automatic instrumentation for popular LLM frameworks and providers. This integration enables you to send OpenLIT traces to Arize AX using OpenInference semantic conventions.

Integration Type

  • Tracing Integration

Key Features

  • Automatic instrumentation for 20+ LLM providers and frameworks
  • Seamless conversion to OpenInference semantic conventions
  • Real-time trace collection and analysis in Arize AX
  • Support for complex LLM workflows and chains

Prerequisites

  • Arize AX account with Space ID and API Key
  • OpenLIT and OpenTelemetry packages
  • Target LLM provider credentials (e.g., OpenAI API key)

Installation

Installation

Quickstart

This quickstart shows you how to view your OpenLIT traces in Arize AX. Install required packages.
Grab your Arize Space ID and Arize API Key from Settings -> API Keys. Here’s a simple example that demonstrates how to convert OpenLIT traces into OpenInference and view those traces in Arize AX:

This example:

  1. Uses OpenLIT Instrumentor to instrument the application.
  2. Uses Langchain to build an email writer. Has three nodes -> generating an outline, writing an email, and checking tone. Each of these are OpenAI calls, and the nodes are connected through Langchain.
  3. Queries are exported to Arize AX using a span processor.
The traces will be visible in your Arize AX platform.