​

Enhanced Usage Monitoring

• Datasource-level breakdowns for granular usage visibility
• Account-based tracking with improved join keys for accurate reporting
• 10-minute update intervals for near real-time usage insights
• Automated cleanup of expired data for accurate retention calculations

​

Improved Onboarding Experience

• Redesigned onboarding cards with clearer visual hierarchy
• “My First Playground” experience for hands-on experimentation
• Role collection during signup for personalized setup
• Custom hover states matching each card’s accent color

​

Real-Time Evaluations

• Instant evaluation of production traces without delays
• Latent evaluation support for updating earlier spans
• Seamless cutover between batch and real-time processing
• Available across all Arize AX tiers by default

​

AWS Bedrock Custom Endpoints

• Custom base URL support for private endpoints
• Inference profile ARNs for multi-region routing
• Custom model configurations for specialized deployments
• Simplified regional management with unified tracking

​

Wildcard Array Path Variables

• Wildcard (*) patterns to reference all array elements
• Last-index (-1) access for the most recent item
• Automatic generation of wildcard variants for convenience
• Support in task variables and experiment columns

​

Improved Queue Management

• Duplicate detection with clear error messages
• Added and skipped record counts after bulk operations
• Actionable feedback when attempting to add existing records

​

Session Evaluations with Conversation Context

• {conversation} template variable for session-level evaluations
• Chronologically ordered input/output pairs
• Automatic aggregation of multi-turn dialogues
• Root span filtering for accurate session context

​

Circuit Breaker for Evaluation Tasks

• Immediate abort on authentication errors (401/403)
• Automatic detection of systemic issues after 10 consecutive failures
• Failure rate monitoring to stop doomed batches early
• Resource optimization by preventing guaranteed-to-fail requests

​

Tracing Configuration for Evaluation Tasks

• Toggle tracing on/off in Advanced Options
• Automatic trace generation for monitoring and debugging
• Persistent settings saved with your tasks
• Production-ready visibility into evaluation execution

​

Enhanced RBAC System

• Custom roles with specific permissions
• Space-level role bindings for granular access management
• Coexistence with legacy roles during migration
• UI support for role assignment across all user management pages
• Automatic fallback to legacy roles when custom roles are deleted

​

Enhanced Dashboard Time Persistence

• Auto-save time range, time zone, and granularity selections
• Instant restoration when returning to dashboards
• Per-dashboard settings for customized views
• Seamless experience across sessions

​

Trace Table Performance Improvements

• 30-50% faster initial load times
• String truncation for large content
• Lazy loading of full values in tooltips
• Minimal impact on user experience

​

Expandable Trace Hierarchy

• Expand traces to see child spans inline
• Hierarchical visualization without opening slideouts
• Faster navigation through complex traces
• Contextual understanding of request flow

​

Custom Prompt Release Labels

• Tag prompt versions with meaningful identifiers
• Environment markers like “staging” or “production”
• Dynamic label suggestions from existing prompts
• Easy retrieval of specific prompt releases

​

Enhanced Annotation Configs

• Color-coded categories based on optimization direction
• Read-only view for reviewing existing configs
• Optimization direction control (maximize, minimize, or none)
• Clear label guidance for consistent evaluations

​

Eval Hub Enhancements

• Model information in evaluator listings with provider icons
• Evaluator counts in running tasks with hover details
• Automatic save when creating or editing evaluators
• Streamlined task flow for faster evaluation setup

​

Todo List Management Improvements

• Visual status indicators for all todo states
• Dynamic reminders with exact update calls needed
• Plan preservation across human-in-the-loop pauses
• Clearer instructions positioned near the plan

​

Stacked Bar Chart Widgets

• Stacked bar charts for comparing categories over time
• Druid-powered queries for fast rendering
• Customizable groupings and dimensions
• Dashboard integration for comprehensive monitoring

​

Scatter Plot Widgets

• Correlation analysis for two numeric dimensions
• Interactive data points for detailed investigation
• Dashboard integration for visual analytics
• Customizable axes and filtering

​

Enhanced Monitor Configuration

• Configurable auto-threshold lookback windows via feature flag
• Extended lookback periods for sparse data projects
• Flexible threshold calculation based on historical patterns
• Account-specific customization for unique requirements

​

Java SDK Space ID Support

• Space ID authentication (space keys deprecated)
• Backward compatibility maintained with existing constructors
• Updated documentation and examples
• Test coverage for new authentication method

​

Improved Error Handling for Exceptions

• Filter by exception.type and exception.message in the UI
• OpenInference semantic convention support for exceptions
• Consistent data structure across datasources
• Faster troubleshooting of error patterns

​

SAML Role Mapping Search

• Client-side search across attributes, spaces, roles, and organizations
• Visual highlighting of search matches
• Keyboard navigation through results
• Improved usability for enterprise customers

​

Span-to-Queue Workflow

• Multiple entry points from spans table, trace slideover, and queue records
• New or existing queue selection
• Batch operations for efficient queue population
• Dataclusters integration for reliable processing

​

Enhanced Session Slideover

• Trace labels with links to detailed views
• Visual separators between traces
• Hover highlighting synchronized between list and conversation
• Improved readability for multi-turn interactions

​

Batch Annotation Updates

• Optimization direction support in annotation configs
• Category-based labeling for issue detection
• Best practice guidance for naming and structure
• Streamlined categorization workflows

​

Prompt Optimization on Experiments

• Experiment selector in optimization task creation
• Dynamic column resolution for experiment data
• Enhanced iteration on proven prompts
• Seamless workflow from experiments to optimization

​

Custom Metrics with LIKE Operator

• LIKE and ILIKE operators for pattern matching
• Wildcard support with % syntax
• Case-insensitive matching with ILIKE
• Direct Druid mapping for performance

​

Dashboard Template Filtering

• LLM-only space filtering shows only relevant templates
• Context-aware templates based on project types
• Reduced clutter in template selection
• Consistent experience across spaces and projects

​

Pivot Table Widget Schema

• Grouped categorical dimensions for organized views
• Configurable numeric columns with aggregations
• Flexible filtering and time range support
• Dashboard integration ready

​

Enhanced Space Model Schema

• Space-level schema lookback overrides for custom retention
• Model-specific configurations for unique requirements
• Flexible data management across different use cases

​

Exact Match Code Evaluator

• String equality checks for exact matches
• Expected vs actual comparisons for testing
• Multi-field access with dataset row support
• Alphabetically sorted evaluator list in UI

​

Experiment Task Timeout Configuration

• Configurable timeout parameter beyond 120 seconds
• Function-level control in run_experiment and evaluate_experiment
• Backward compatibility with default values
• Support for complex evaluators requiring extended processing

​

Arrow Schema Reconciliation

• Parallel schema fetching from historicals
• Unified schema reconciliation across partitions
• Automatic conversion for schema consistency
• Support for both Druid and Arrow segments

​

Atlantis Terraform Automation

• Pull request integration for Terraform plans
• Automated plan posting as PR comments
• DevOps team permissions for webhook debugging
• Structured review process before applying changes

​

Google Analytics 4 BigQuery Sync

• Daily GA4 to BigQuery transfers via Terraform
• Raw event data access for advanced analysis
• Overcome GA4 limitations like sampling and retention
• Custom reporting capabilities with full data access

​

Vertex AI Migration

• Seamless Vertex AI connectivity for LLM applications
• Enhanced observability for Google Cloud deployments
• Modernized instrumentation for better tracing

​

Custom Model Migrations

• Custom model endpoint support in evaluations
• Higher traffic model optimization for performance
• Flexible integration options for enterprise deployments

​

Generative Service Monitoring

• Uptime and health alerts with paging
• CPU and memory monitoring with warnings
• Dedicated Grafana dashboard for visibility
• Runbook documentation for incident response

​

Labeling Queue Annotations

• Clear annotations (reset to null) anywhere
• Support across spans, queues, and experiments for consistent workflows
• Improved annotation lifecycle management

​

Enhanced Eval Hub Empty States

• Improved empty state design with clear next steps
• Documentation links for learning resources
• Actionable cards for common workflows

​

Resizable Trace Slideover

• Draggable slideover width for optimal layout
• Persistent sizing preferences across sessions
• Better content visibility for long traces

​

Configurable Experiment Timeout

• Custom timeout values for long-running tasks
• Per-experiment configuration for flexibility
• Backward compatible defaults for existing code

​

Enhanced Platform Stability

• Configuration drift resolution in GCP Terraform
• Enhanced error handling across services
• Improved logging and monitoring for faster troubleshooting
• Database migration optimizations for schema updates
• Better resource management for high-volume workloads

​

Evaluator Hub: Reusable Evaluators

​

Why Reusable Evaluators?

• Consistency: The same evaluator definition is used across tasks, eliminating drift in evaluation criteria
• Reliability: LLM configuration (model, provider, parameters) is set at the evaluator level, ensuring the evaluator is tested and validated with a specific model before being deployed to production tasks
• Version Control: Track changes to evaluators over time with commit messages, making it easy to audit and roll back if needed
• Flexibility: Column mappings let you reuse the same evaluator across datasets with different schemas by mapping template variables to your data columns

​

What’s New

• Evaluator Hub tab: Browse, search, and manage all your evaluators in one place
• Running Tasks tab: View and manage your active evaluation tasks
• “Use Evaluator” action: Quickly create a task with any evaluator pre-selected
• Column Mappings: Map evaluator template variables to your datasource columns when adding an evaluator to a task
• Evaluator Versioning: Create new versions of evaluators with commit messages to track changes

​

Getting Started

1. Navigate to Evaluators in the left sidebar
2. Click New Evaluator to create your first reusable evaluator
3. Choose from pre-built templates or create a custom evaluation from scratch
4. Use your evaluator in tasks by clicking Use Evaluator or selecting it when creating a new task

​

Multi-Span Filters

• AND, OR, NOT operators for combining conditions
• Indirectly Calls (->) and Directly Calls (=>) relationship filters
• Up to 5 filters to find complex patterns like “spans where A calls B, but not C” or “traces containing both X and Y”
• Parentheses to build complex queries and pinpoint the traces that matter

​

Support for Opus & Haiku 4.5

​

Support for GPT-5.2 and GPT-5.2 Pro

​

Improved Playground Views

• LLM Config (provider, model selection, model params, custom endpoint settings)
• Prompt Setup (messages, roles, message content, tool and function calls)
• Generated Results (when setup with datasets)
• Connected Datasource (dataset or span)

​

Realtime Ingestion for all new Arize AX Spaces

​

Structured Outputs Support for Playground

​

Session Annotations

• Input/Output Level: Attach insights to specific output messages, automatically linked to the root span of the trace.
• Span Level: Dive deeper into a trace and annotate individual spans for precise, context-rich feedback.

​

Integrations Revamp

​

OpenInference TypeScript 2.0

• Added easy manual instrumentation with the same decorators, wrappers, and attribute helpers found in the Python openinference-instrumentation package.
• Introduced function tracing utilities that automatically create spans for sync/async function execution, including specialized wrappers for chains, agents, and tools.
• Added decorator-based method tracing, enabling automatic span creation on class methods via the @observe decorator.
• Expanded attribute helper utilities for standardized OpenTelemetry metadata creation, including helpers for inputs/outputs, LLM operations, embeddings, retrievers, and tool definitions.
• Overall, tracing workflows, agent behavior, and external tool calls is now significantly simpler and more consistent across languages.

​

API-Driven Monitors

​

Automatic Threshold Ranges for Monitors

​

Data Fabric

​

New Timeline Tab for Traces

​

Tags

• Describe source (from-prod, EHR-record)
• Encode purpose (ab-test, regression-test)
• Indicate readiness (golden, deprecated)
• Group by config (threshold-0.85, cohort_5)

​

Sort Datasets and Experiment Listing Table

​

Support for Tool Call IDs in OpenInference Messages

​

Add Data Region to Login Page

​

Add Auth Failures to Tracing

​

Total Traces on Stats Bar

​

Support for GPT OSS Models on Bedrock

​

Expanded LLM Support

​

Dashboard Widget Time Setting

​

Autocomplete for Annotations on Datasets

​

Dataset Management Upgrades