Skip to main content
When you open Alyx from the Datasets or Experiments pages, Alyx has context of your datasets, experiments, and eval results. Use it to analyze experiment runs, manage datasets, create or append synthetic data, and get eval insights.

​
Where to find Alyx

Open the Alyx chat from the Datasets or Experiments pages. Alyx has context of your datasets, experiments, and eval results.
Open Alyx from Datasets or Experiments to analyze runs and manage datasets

​
Key skills

SkillDescription
List datasetsList available datasets
Dataset previewInspect dataset structure and sample rows
Create synthetic datasetCreate a new dataset with synthetic examples
Append synthetic dataAdd synthetic examples to an existing dataset
Create dataset from spansBuild a dataset from trace spans
Append spans to datasetAdd spans from traces to an existing dataset
Get experimentsFetch experiment data for analysis and comparison
List / choose evalsList evals attached to datasets; select or attach evals
…and more. Alyx can explore large experiment outputs.

​
Example prompts

  • “Analyze and compare the outputs of my last two experiments”
  • “Create a synthetic dataset with 100 examples for regression testing”
  • “Summarize the eval results across these experiments”
  • “What’s the difference in token usage between experiment A and B?”
  • “Which experiment has the best hallucination score?”