​

SDKs & REST APIs

• Evaluators (Python & JavaScript SDKs): Create, manage, and version evaluators programmatically through Python and JavaScript SDKs. Full create, read, update, and delete operations for evaluators, plus list, create, and retrieve for evaluator versions. Enables automated evaluator lifecycle management and integration of evaluation workflows into existing development processes.
• Prompts (Python & JavaScript SDKs): Manage prompts and prompt versions through Python and JavaScript SDKs with full create, read, update, and delete operations across all prompt and version endpoints. Includes label management for organizing and retrieving specific versions. Set labels like “production” on any version for easy resolution, and labels automatically move when reassigned.
• AI Integrations (Python SDK): Connect Arize AX with AI frameworks programmatically through the Python SDK. List, create, update, and delete integrations to automate the setup of instrumentation and monitoring across your AI applications.
• Roles Management: Create, read, update, and delete custom roles through the API, enabling programmatic role management and automated access control workflows across your organization.
• Name-Based Search: Find resources faster with case-insensitive name search across all major list endpoints including projects, prompts, datasets, experiments, spaces, annotation configs, and annotation queues. Flexible substring matching enables quick resource location without remembering exact names.
• Space Deletion: Manage the full space lifecycle through the API with the ability to delete spaces programmatically, completing the set of space management operations.

​

Evaluator Improvements

• Generic Variables with Auto-Mapping: Streamlined evaluator setup with intelligent variable mapping. When creating an evaluator from a template or blank, recognized variables like input, output, question, reference, and tool_call are automatically mapped based on the selected datasource type (span attributes for Projects or column names for Datasets). Override any mapping with a single click via dropdown or freetext for full customization.
• Better Validation for Code Evaluators: Enhanced validation and error messaging when creating or editing code evaluators, with clearer feedback on syntax errors and missing required fields. Catches issues early before running full evaluations, reducing wasted compute and iteration time.
• Online Task Resources Configuration: Configure CPU and memory resources for online task evaluators to optimize performance and cost based on workload requirements. Provides more granular control over how evaluations run at scale.

​

Alyx Improvements

• Multi-Span Support: Alyx can now analyze and work with multiple spans simultaneously, enabling more powerful conversational debugging and analysis workflows across traces without switching context.
• Dataset Page Context: Alyx now has richer awareness on dataset pages, including selected experiments, latest available experiments, and active evaluators. Provides more relevant, context-specific assistance when working with datasets and experiments.
• Auto-Trigger on Destination Pages: When the home page Alyx links to another page, it can now auto-open the destination page’s Alyx with context pre-loaded, providing seamless continued help across navigation.

​

Annotation Improvements

• Queue Records Management: Add and delete records from annotation queues with new record operations. Assignee and status filters now persist in the URL for easy sharing and bookmarking, with an empty state UI for guidance when no filters are applied.
• Session Slideover Annotations: The annotate button has moved from individual messages to the trace level in session conversations for clearer context. A trace number subtitle now appears in the annotation panel, making it clear which trace is being annotated.
• View Source Data: Clicking “View Source Data” in annotation queues now opens the full span dialog instead of a limited preview, providing complete trace context for more informed annotation decisions.

​

CLI Commands

• Spaces Management: Create, list, get, and update spaces directly from the command line with formatted table output. The Spaces API has been promoted to stable, providing reliable programmatic access to space management.
• Profile Recovery: The CLI now gracefully handles invalid or extra configuration fields instead of crashing. A new profile fix command helps diagnose and repair broken profile configurations, enabling quick recovery from configuration issues without manual file editing.

​

Trace & Session Improvements

• Saved Filters Migration: Saved trace filters have been automatically migrated to the new trace views system with improved comparison logic that handles filter order correctly. Existing saved filters continue to work seamlessly.
• Sessions in Filter Slideover: The filter slideover now includes a sessions table, making it easier to build filters based on session-level attributes and metadata alongside existing trace filters.
• Copy Trace Events: Quickly copy event details (name, message, stacktrace, and timestamp) from trace slideover events with a single click, streamlining debugging workflows and issue reporting.

​

Dashboard Export

​

Webhooks

​

Bedrock Integration Updates

• Bearer Token Authentication: Added support for AWS Bedrock integrations using bearer token authentication, providing a simpler alternative to IAM-based credential management for teams that prefer token-based auth workflows.
• Inference Profile Support: AWS Bedrock inference profiles are now fully supported without requiring model IDs to be in a predefined allowlist. Unknown inference profile identifiers pass through directly to Bedrock for native error handling, enabling immediate use of custom or newly released profiles.

​

Usage Module in Navigation

​

Dataset Summary Columns

​

IT Administrators Role