> ## Documentation Index
> Fetch the complete documentation index at: https://arize-ax.mintlify.dev/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Arize AX

> AI Engineering Platform

AX gives AI engineers and product managers the tools to observe, improve, and evaluate their AI agents and AI applications with confidence.

Trusted by teams building agents at:

![Logos of teams and organizations that use Arize AX](https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/evaluate/may5logos.svg)

## Arize AX Features

<Tabs>
  <Tab title="🔀 Observe">
    <Frame>
      <video src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/evaluate/ax-observe.mp4" width="100%" height="100%" style={{ display:"block",objectFit:"fill",backgroundColor:"transparent" }} controls autoPlay muted loop />
    </Frame>

    **Trace your application**

    * [Learn more about tracing](/ax/instrument/what-are-traces) - Tracing concepts
    * [Setup tracing](/ax/observe/tracing/) - get instant visibility into your application traces using manual or auto-instrumentation (choose from 30+ providers and frameworks)
    * [Find problematic traces](/ax/observe/tracing/view-and-manage-traces#querying-and-filters) - use queries, filters, and AI Search to find bad experiences
    * [Run quick evaluations](/ax/evaluate/create-evaluators) - create evaluators to score spans and traces at scale
  </Tab>

  <Tab title="✅ Evaluate">
    <Frame>
      <video src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/evaluate/ax-evaluate.mp4" width="100%" height="100%" style={{ display:"block",objectFit:"fill",backgroundColor:"transparent" }} controls autoPlay muted loop />
    </Frame>

    **Evaluate performance**

    * [Annotate your outputs](/ax/evaluate/human-review#annotate-your-spans) - annotate data to identify failure patterns
    * [Evaluate production data](/ax/evaluate/run-evals-on-traces) - run evals continuously against your traces, spans or sessions
    * [Evaluate experiment results](/ax/evaluate/run-evals-on-experiments) - systematically measure how different prompts & models perform
    * [Track key metrics](/ax/evaluate/evals-overview) - create custom dashboards to monitor performance
    * [Get alerts](/ax/observe/production-monitoring/) - get alerts when performance deviates from the norm
    * [Guardrail bad outputs](/ax/security-and-settings/llm-security/guardrails) - prevent poor performing outputs from reaching users
    * [Align evals](/ax/evaluate/align-evals-to-human-feedback) - calibrate automated scores against ground truth human judgments so you can trust what your evals are actually measuring.
  </Tab>

  <Tab title="🛠 Improve">
    <Frame>
      <video src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/evaluate/ax-improve.mp4" width="100%" height="100%" style={{ display:"block",objectFit:"fill",backgroundColor:"transparent" }} controls autoPlay muted loop />
    </Frame>

    **Run experiments**

    * [Curate datasets](/ax/develop/datasets) - create and update test datasets to measure performance
    * [Track experiments](/ax/develop/datasets-and-experiments/log-experiment) - store every experiment run in a structured format
    * [Evaluate experiments](/ax/develop/datasets-and-experiments/create-an-experiment-evaluator/) - systematically measure performance improvements based on LLM and code evaluations
    * [CI/CD](/ax/develop/datasets-and-experiments/ci-cd-for-automated-experiments/) - gate deployment to production based on experiment performance

    **Iterate on prompts**

    * [Prompt playground](/ax/prompts/prompt-playground/) - compare different prompts side by side
    * [Prompt hub](/ax/prompts/prompt-hub/) - manage and version your prompts in one place
    * [Prompt builder](/ax/prompts/prompt-optimization/ai-powered-prompt-builder) - generate prompts with AI
    * [Save as experiment](/ax/prompts/prompt-playground/save-playground-outputs-as-an-experiment) - systematically A/B test prompts against large datasets
  </Tab>

  <Tab title="✨ Alyx">
    <Frame>
      <video src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/evaluate/ax-alyx.mp4" width="100%" height="100%" style={{ display:"block",objectFit:"fill",backgroundColor:"transparent" }} controls autoPlay muted loop />
    </Frame>

    **Build AI with AI**

    Alyx meets you where you are - whether you're debugging a trace, running an experiment, or building evals.

    * [Traces](/ax/alyx?tab=Observe#observe) - ask "why is this span slow" or "find all traces where the agent hallucinated" and get an answer you can take action on.
    * [Evals](/ax/alyx?tab=Evaluate#evaluate) - create an eval from a template or write a custom one, then run it over your data
    * [Experiments](/ax/alyx?tab=Improve#improve) - compare runs, understand what changed, and identify what to tweak before shipping to production.
    * [Prompts](/ax/alyx?tab=Improve#improve) - write, iterate on and save versioned prompts, get suggested edits grounded in what your experiment data actually shows.
    * [Dashboards](/ax/alyx) - describe the metric you want to track, get a widget. No query language required.
  </Tab>
</Tabs>

# Next Steps

<CardGroup cols={2}>
  <Card title="Agents" icon="robot" iconType="solid" color="#ff52da" href="/ax/agents">
    AX Agent Improvement Loop—Signal for issue discovery, Studio for tasks, automations on a schedule.
  </Card>

  <Card title="Use AX in your coding agent" icon="sparkles" iconType="solid" color="#ff4fd8" href="/ax/set-up-with-ai-assistants">
    Let your agent do the work of integrating and getting results out of AX with our comprehensive Agent Skills.
  </Card>

  <Card title="Get Started with AX" icon="rocket" iconType="solid" color="#ff63dc" href="/ax/get-started/get-started-tracing">
    Get started with Tracing, Evals, Development and Experimentation workflows for your AI product.
  </Card>

  <Card title="Try our tutorials" icon="book-open" iconType="solid" color="#ff78e2" href="/ax/cookbooks">
    Check out a comprehensive list of example notebooks for agents, RAG, voice, tracing, evals, and more.
  </Card>

  <Card title="Watch our paper readings" icon="video" iconType="solid" color="#ff8be8" href="https://arize.com/ai-research-papers/">
    See our video deep dives on the latest papers in AI.
  </Card>

  <Card title="Join our Slack community" icon="comments" iconType="solid" color="#ff73df" href="https://arize.com/community/">
    Join the Arize Slack community to ask questions, share findings, provide feedback, and connect with other developers.
  </Card>

  <Card title="Need OSS?" icon="box" iconType="solid" color="#ff5ad9" href="https://arize.com/docs/phoenix">
    Check out our OSS product - Phoenix.
  </Card>
</CardGroup>