February 2025

​

What’s New

​

Labeling Queues

• New Annotator Role – A dedicated RBAC role with focused permissions, ensuring annotators only see assigned records while keeping other data secure.
• Seamless Queue Creation – Create Labeling Queues directly from dataset records, with annotations automatically written back for easy tracking.
• Annotation Resets – AI Engineers can reset annotations, allowing re-labeling when needed.
• Flexible Assignment Methods – Choose between Random or All assignments for annotators in a queue.
• Fast & Streamlined UI – Optimized for quick labeling workflows with: Hotkey support, background data fetching & pagination, and background submissions.

​

Enhancements

​

Expand/Collapse Rows in the Trace Table

​

Monitor Runtime

• Hourly & Daily: Select specific days of the week.
• Daily, Weekly & Monthly: Runs at 12 AM UTC after creation.
• Default Behavior: Monitors will continue running every 3 hours, 7 days a week unless configured otherwise.

​

Column Specification With Exporting Data

• Specify which columns of data you’d like to export when exporting data via the ArizeExportClient
• When using the export_model_to_df function, users can specify the columns parameter to only export specific columns.

​

Create a Dataset from CSV

​

Monitor Improvements

• Cardless Design – A sleek, modern table view for better readability.
• Project-Level Monitors – LLM and ML monitors now have separate tabs.
• Search & Sort – Find monitors by name or dimension, plus sort by any column.
• Summary Stats – See how many monitors triggered in the last 24 hours
• New LLM Monitor Types – Clearer categories:
  • Custom Metric Monitor → Performance Monitor with a custom metric preselected.
  • Span Property Monitor → Data Quality Monitor for span properties.
  • Evaluation Monitor → Data Quality Monitor for evaluations.
  • Quick Monitor for Errors – Easily enable error count monitoring (count, status_code = ERROR).

​

OTEL Tracing Via HTTP

• To use:* S*pecify /v1/traces as the endpoint and Transport.HTTP as the transport in our register helper

// tracer_provider = register(
    endpoint="https://otlp.arize.com/v1/traces",     # NEW
    transport=Transport.HTTP,                        # NEW
    space_id=SPACE_ID,
    api_key=API_KEY
    project_name="test-project-http",
)

​

📚 New Content