Skip to main content
In the Prompt Playground you’re iterating on prompts, datasets, evals, and experiments. Alyx can use the Playground UI for you—state what you want and Alyx does it. Attach a dataset, change the prompt, add an eval, run an experiment, save to the hub: if you would do it in the Playground, you can ask Alyx to do it. Alyx has full context of your current prompt, attached dataset, evals, and experiments.

Where to find Alyx

Open the Alyx chat from the Prompt Playground page. Alyx has context of your current prompt, attached dataset, evals, and experiments.
Open Alyx from the Prompt Playground to iterate on prompts and experiments

Key skills

SkillDescription
Create or edit promptModify the prompt in the playground
Optimize or align promptImprove prompt based on eval performance or goals
Build evalWrite a custom eval for your application
Attach dataset / select columnsAttach a dataset and choose which columns to use
Synthetic datasetsCreate or append synthetic data
Run experimentExecute an experiment; get results and compare runs
Load / save promptsLoad from hub, save to hub, save new versions
Choose evalsSelect or attach evals; detach from playground
…and more. Alyx can configure online task params.

Example prompts

  • “Optimize this prompt to reduce hallucinations”
  • “Attach the regression-test dataset and use only the question and answer columns”
  • “Build an eval to check if the response is helpful”
  • “Run an experiment and compare the results to the last run”
  • “Create a synthetic dataset with 50 examples that test edge cases”
  • “Save this prompt to the hub as a new version”