Skip to main content
The Eval Health Agent is part of managed agents on Enterprise. Signal and managed agents are currently included at no additional charge for Enterprise. See Pricing and usage.
The Eval Health Agent reviews the evals already running on a tracing project, works out which ones the app is missing, and flags evals that cost more than they need to or no longer tell you anything. Each finding is filed as an issue with a proposed change attached. The agent never creates or edits an eval on its own: nothing changes until you accept the proposal.

​
What it finds

Each run proposes at most 5 new evals. Optimizations and fixes don’t count toward that cap. Most runs reconfirm what is already filed, so a run that files nothing new is a valid result.

​
Run it

Signal & Agents → + New Agent → Monitor & optimize → Eval Health, or open a tracing project and choose Agents → Eval Health → Enable Agent.
It needs a space default LLM integration with a default model. The evals it proposes are LLM-as-a-judge evaluators that run on that integration. If the space has none, setup stops with a prompt to set one in Space Settings. See AI provider integrations.
The first run starts as soon as you save, then it follows the schedule. Pause or resume it from the settings menu on the Eval Health tab.

​
What it reads

Each run reads the project’s eval tasks, the space’s evaluators, and up to 100 spans from the last 7 days to see what the app actually does. Before proposing a variable mapping, it checks the mapping resolves against a real span.

​
Review findings

Findings appear on the project’s Eval Health tab, which shows once the project has an agent, and on the space-wide Issues page with an Eval Health badge. The tab summarizes healthy evaluators, coverage gaps, efficiency and effectiveness findings, and how many proposals need review. Each issue carries an action card. Accepting runs with your permissions, and every card also has Dismiss.
If the eval changed after the agent proposed a fix, Apply fix and Apply are rejected with “Eval changed since this fix was proposed” rather than overwriting your edit. Wait for the next run to propose against the current version.
If you lack permission to accept a card, it asks you to have a space admin accept it.