OpenInference Repo

OpenInference is a set of conventions and plugins that is complimentary to OpenTelemetry to enable tracing of AI applications. It instruments and monitors different code executions across models, frameworks, and vendors and maps them to a set of standardized attributes for traces and spans. OpenInference is natively supported by Arize, but can be used with any OpenTelemetry-compatible backend as well. OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.

Python

Package	Description	Version
`openinference-semantic-conventions`	Semantic conventions for tracing of LLM Apps.
`openinference-instrumentation-openai`	OpenInference Instrumentation for OpenAI SDK.
`openinference-instrumentation-llama-index`	OpenInference Instrumentation for LlamaIndex.
`openinference-instrumentation-dspy`	OpenInference Instrumentation for DSPy.
`openinference-instrumentation-bedrock`	OpenInference Instrumentation for AWS Bedrock.
`openinference-instrumentation-langchain`	OpenInference Instrumentation for LangChain.
`openinference-instrumentation-mistralai`	OpenInference Instrumentation for MistralAI.
`openinference-instrumentation-guardrails`	OpenInference Instrumentation for Guardrails.
`openinference-instrumentation-vertexai`	OpenInference Instrumentation for VertexAI.
`openinference-instrumentation-crewai`	OpenInference Instrumentation for CrewAI.
`openinference-instrumentation-haystack`	OpenInference Instrumentation for Haystack.
`openinference-instrumentation-litellm`	OpenInference Instrumentation for liteLLM.
`openinference-instrumentation-groq`	OpenInference Instrumentation for Groq.
`openinference-instrumentation-instructor`	OpenInference Instrumentation for Instructor.
`openinference-instrumentation-anthropic`	OpenInference Instrumentation for Anthropic.

Javascript

Package	Description	Version
`@arizeai/openinference-semantic-conventions`	Semantic conventions for tracing of LLM Apps.
`@arizeai/openinference-core`	Core utility functions for instrumentation
`@arizeai/openinference-instrumentation-openai`	OpenInference Instrumentation for OpenAI SDK.
`@arizeai/openinference-instrumentation-langchain`	OpenInference Instrumentation for LangChain.js.
`@arizeai/openinference-vercel`	OpenInference Support for Vercel AI SDK

Quickstart

Instrument

Observe

Agents

Evaluate

Improve

Machine Learning

Settings

Security

What is OpenInference?

OpenInference Repo

Python

Javascript

OpenInference Repo

​Python

​Javascript

Python

Javascript