12.05.2024
New Releases, Enhancements, + Changes
Copilot Enhancements
Span Chat
The Copilot Span Chat skill makes getting value from spans faster and easier. Rather than spending time scrolling through and deciphering span data , teams can now:
Analyze spans to extract key insights
Ask questions to quickly understand span data
Run evaluations on individual spans
Dashboard Widget Generator
Building dashboard plots just got way easier. The dashboard skill lets teams:
Create time series plots or distributions from natural language
Translate code (like Plotly) into ready-to-go visualizations
Handle ambiguous filters like "west coast states" and plot multiple widgets at once
Misc. Copilot Updates
We’ve revamped the main chat experience to be always accessible on the page, with an option to collapse the input bar
The Custom Metric skill now supports a conversational flow, making it easier for users to iterate and refine metrics dynamically
Additional Enhancements
Experiment Projects
Experiment traces for a dataset are now consolidated and can be accessed under "Experiment Projects" on the "Projects & Models" page.
Multi-Class/Label Per-Class Calibration & Chart
We’ve just rolled out per-class calibration metrics and calibration chart. Users can see calibration scores for each class separately and view the calibration chart all in one place.
To view per-class calibration simply select calibration from the metric dropdown and choose a class
The calibration chart can be found under the "More Charts" tab
SDK Version 7.29.0
Log experiments from a previously created dataframe
📚 New Content
The latest video tutorials, paper readings, ebooks, self-guided learning modules, and technical posts:
🧑⚖️ Agent-as-a-Judge: Evaluate Agents with Agents
🤖 LLM-as-a-Judge Evaluation for GenAI Use-Cases
🌎 Building an AI Agent that Thrives in the Real World
Last updated
Was this helpful?