Autonomous evaluation systems are eval systems that can run, analyze, and act on evaluation workflows with limited human intervention. They might detect regressions, generate new test cases, assign failures to owners, open issues, or propose prompt changes.
The safe version is bounded autonomy. The system can automate repetitive work, but policies define what it can change, what requires approval, and how results are audited.