Arize Release Notes: New Copilot Skills, Local Explainability, and More.
Sarah Welsh
Contributor
Welcome to our regular update on new releases, enhancements, and changes.
What’s New
New Copilot Skills
Custom Metric Skill: Copilot now writes custom metrics! Users can generate their desired metric by having copilot translate natural language descriptions or existing code (e.g., SQL, Python) into AQL. Learn more
Embedding Summarization Skill: Copilot now works for embeddings! Users can select embedding data point and Copilot will analyze for patterns and insights. Learn more
Enhancements
Local Explainability Report
Local Explainability is now live, providing both a table view and waterfall style plot for detailed, per-feature SHAP values on individual predictions. Learn more
Experiment Over Time Widget
This widget allows users to integrate experiment data directly into their dashboards for ongoing visibility and analysis. Users can now:
- Select dataset of interest
- Choose specific evaluations they want to visualize over time
- Complete with direct connectivity to experiment details, making it easy to access the individual experiment results
Full Function Calling Replay in Prompt Playground
Now users can follow the full function calling tutorial from OpenAI and iterate on different functions in different messages from within the Prompt Playground.
Instrumentation Enhancements
- Context Attribute Propagation: Arize now has a set of utilities (eg: using_session) that allow users to set properties on context. All of these properties will be picked up by all of our auto instrumentations and added to spans. Learn more
- Typescript Trace Configuration: Typescript auto instrumentations now accept a trace configuration which allows for data masking and configuration of attribute values on spans. Learn more
- Vercel AI SDK: Users can now ingest traces created by the Vercel AI SDK into Arize. Learn more
- LangChain Auto Instrumentation: Arize’s LangChain auto instrumentation now supports langchain.js version 0.3 and is backwards compatible with all previous versions. Learn more
📚 New Content
The latest video tutorials, paper readings, ebooks, self-guided learning modules, and technical posts:
🧑🏫 Prompt Optimization Course
📊 Evaluation Workflows to Accelerate Generative App Development and AI ROI
🐝 Swarm: OpenAI’s Experimental Approach to Multi-Agent Systems
✏️ LLM Evaluation Course
🤖Techniques for Self-Improving LLM Evals