Skip to main content
OpenInference is a set of conventions and plugins that is complimentary to OpenTelemetry to enable tracing of AI applications. It instruments and monitors different code executions across models, frameworks, and vendors and maps them to a set of standardized attributes for traces and spans. OpenInference is natively supported by Arize, but can be used with any OpenTelemetry-compatible backend as well. OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.

Python

PackageDescriptionVersion
openinference-semantic-conventionsSemantic conventions for tracing of LLM Apps.PyPI Version
openinference-instrumentation-openaiOpenInference Instrumentation for OpenAI SDK.PyPI Version
openinference-instrumentation-llama-indexOpenInference Instrumentation for LlamaIndex.PyPI Version
openinference-instrumentation-dspyOpenInference Instrumentation for DSPy.PyPI Version
openinference-instrumentation-bedrockOpenInference Instrumentation for AWS Bedrock.PyPI Version
openinference-instrumentation-langchainOpenInference Instrumentation for LangChain.PyPI Version
openinference-instrumentation-mistralaiOpenInference Instrumentation for MistralAI.PyPI Version
openinference-instrumentation-guardrailsOpenInference Instrumentation for Guardrails.PyPI Version
openinference-instrumentation-vertexaiOpenInference Instrumentation for VertexAI.PyPI Version
openinference-instrumentation-crewaiOpenInference Instrumentation for CrewAI.PyPI Version
openinference-instrumentation-haystackOpenInference Instrumentation for Haystack.PyPI Version
openinference-instrumentation-litellmOpenInference Instrumentation for liteLLM.PyPI Version
openinference-instrumentation-groqOpenInference Instrumentation for Groq.PyPI Version
openinference-instrumentation-instructorOpenInference Instrumentation for Instructor.PyPI Version
openinference-instrumentation-anthropicOpenInference Instrumentation for Anthropic.PyPI Version

Javascript

PackageDescriptionVersion
@arizeai/openinference-semantic-conventionsSemantic conventions for tracing of LLM Apps.NPM Version
@arizeai/openinference-coreCore utility functions for instrumentationNPM Version
@arizeai/openinference-instrumentation-openaiOpenInference Instrumentation for OpenAI SDK.NPM Version
@arizeai/openinference-instrumentation-langchainOpenInference Instrumentation for LangChain.js.NPM Version
@arizeai/openinference-vercelOpenInference Support for Vercel AI SDKNPM Version

\