All GraphQL mutations

157 mutations are available through the programmatic GraphQL API. Each link goes to the mutation’s arguments, return type and a minimal example. To see which mutations exist for an area of the product, start from the GraphQL overview.

All mutations

Mutation	Area	Description
`addIntegrationToSandboxConfig`	Managed agent and Signal	Add integration to sandbox config.
`addSAMLRoleMapping`	Admin	Add a single role mapping to a SAML Identity Provider without touching its other role mappings.
`addTagsToDataset`	Dataset and annotation	Add tags to dataset.
`addTagsToExperiment`	Dataset and annotation	Add tags to experiment.
`addTagsToModel`	Project and model	Add tags to model.
`assignSpaceMembership`	Admin	Assign multiple users to multiple spaces with appropriate roles
`batchUpdateAnnotations`	Dataset and annotation	Batch update the annotations of a dataset.
`cancelOnlineTaskRun`	Evaluator and task	Cancel an online task run
`copyDashboard`	Dashboard	Copy dashboard.
`createAnnotationConfig`	Dataset and annotation	Create an annotation config
`createAnnotationQueue`	Dataset and annotation	Create an annotation queue
`createAutomation`	Managed agent and Signal	Create a new managed agent automation.
`createBarChartWidget`	Dashboard	Create bar chart widget.
`createByobConnector`	Data import	Create a byob connector
`createCostConfig`	Project and model	Create a cost config
`createCustomLlmEndpoint`	LLM integration	Create custom llm endpoint.
`createCustomMetric`	Project and model	Creates a new custom metric scoped to a space.
`createDashboard`	Dashboard	Create dashboard.
`createDashboardFromTemplate`	Dashboard	Create dashboard from template.
`createDataQualityMonitor`	Monitor	Create data quality monitor.
`createDefaultDashboard`	Dashboard	Create default dashboard.
`createDriftMonitor`	Monitor	Creates a new custom drift monitor.
`createEvalTask`	Evaluator and task	Create a new online eval task
`createEvaluator`	Evaluator and task	Create a new evaluator
`createEvaluatorVersion`	Evaluator and task	Create a new evaluator version
`createExperimentChartWidget`	Dashboard	Create an experiment chart widget
`createExporterAuditLog`	Admin	Create an exporter audit log
`createExternalLlmApiKey`	LLM integration	Create external llm api key.
`createFileImportJob`	Data import	Create a job that will import model inferences from a blob store
`createGoogleCloudIntegration`	LLM integration	Create google cloud integration.
`createIntegrationKey`	Data import	Create integration key.
`createLineChartWidget`	Dashboard	Update a single line chart widget on a dashboard
`createLlmIntegration`	LLM integration	Create llm integration.
`createOrganization`	Admin	Create an organization to populate with spaces
`createPerformanceMonitor`	Monitor	Creates a new custom performance monitor.
`createPivotTableWidget`	Dashboard	Create pivot table widget.
`createPrompt`	Prompt	Create a new prompt
`createPromptOptimizationTask`	Evaluator and task	Create a new prompt optimization task
`createPromptVersion`	Prompt	Create a new prompt version
`createSAMLIdP`	Admin	Create a new SAML Identity Provider configuration
`createSandboxConfig`	Managed agent and Signal	Create sandbox config.
`createSandboxIntegration`	Managed agent and Signal	Create sandbox integration.
`createSandboxJob`	Managed agent and Signal	Create a new managed agent sandbox job
`createSandboxTemplate`	Managed agent and Signal	Snapshot a sandbox and save it as a reusable template for future jobs
`createServiceApiKey`	Admin	Create a new service API key and its associated bot user
`createSpace`	Admin	Create a space within an organization
`createStatisticWidget`	Dashboard	Create statistic widget.
`createTableImportJob`	Data import	Create a job that will import model inferences from a table
`createTextWidget`	Dashboard	Create text widget.
`createTraceFilter`	Project and model	Create a trace filter
`createTriggeredOngoingTableImportJob`	Data import	Create a job that will import model inferences from a table
`createTriggeredOngoingTableRun`	Data import	Schedule a job run that will import model inferences from a table
`createUserApiKey`	Admin	Create a new user API key
`deleteAutomation`	Managed agent and Signal	Soft-delete a managed agent automation.
`deleteBarChartWidget`	Dashboard	Delete bar chart widget.
`deleteByobConnector`	Data import	Delete a byob connector
`deleteByobDatasource`	Data import	Delete a byob datasource
`deleteCostConfig`	Project and model	Deletes a cost config
`deleteCustomLlmEndpoint`	LLM integration	Delete custom llm endpoint.
`deleteCustomMetric`	Project and model	Deletes a custom metric.
`deleteData`	Project and model	Delete data for a specific time period.
`deleteEvaluator`	Evaluator and task	Delete an existing evaluator
`deleteExperimentChartWidget`	Dashboard	Delete experiment chart widget.
`deleteExternalLlmApiKey`	LLM integration	Delete external llm api key.
`deleteFileImportJob`	Data import	Delete an existing job that has been imported from a blob store
`deleteGoogleCloudIntegration`	LLM integration	Delete google cloud integration.
`deleteIntegrationKey`	Data import	Delete integration key.
`deleteLineChartWidget`	Dashboard	Delete line chart widget.
`deleteLlmIntegration`	LLM integration	Delete llm integration.
`deleteModel`	Project and model	Delete model.
`deleteMonitor`	Monitor	Delete monitor.
`deleteOnlineTask`	Evaluator and task	Delete online task.
`deletePivotTableWidget`	Dashboard	Delete pivot table widget.
`deletePrompt`	Prompt	Delete an existing prompt
`deleteSandboxConfig`	Managed agent and Signal	Delete sandbox config.
`deleteSandboxIntegration`	Managed agent and Signal	Delete sandbox integration.
`deleteSignal`	Managed agent and Signal	Delete the Signal automation for a project.
`deleteSpace`	Admin	Delete a space
`deleteSpaceGateLimit`	Admin	Remove a rate limit gate from a space, resetting it to no limit.
`deleteStatisticWidget`	Dashboard	Delete statistic widget.
`deleteTableImportJob`	Data import	Delete an existing job that has been imported from a table
`deleteTextWidget`	Dashboard	Delete text widget.
`deleteTraceFilter`	Project and model	Deletes a traceFilter
`duplicateWidget`	Dashboard	Duplicate widget.
`editEvaluator`	Evaluator and task	Edit an existing evaluator
`editPrompt`	Prompt	Edit an existing prompt
`migrateTaskToEvalHub`	Evaluator and task	migrates a task’s evaluators to eval hub
`openSignalIssueGitHubIssue`	Managed agent and Signal	File a GitHub issue for a Signal issue, using the project’s Signal repo and its connected GitHub token.
`openSignalIssuePR`	Managed agent and Signal	Launch a managed agent sandbox job that fixes a Signal issue and opens a PR, borrowing the project’s Signal automation repo/agent config.
`patchDataQualityMonitor`	Monitor	Patch data quality monitor.
`patchDriftMonitor`	Monitor	Patch drift monitor.
`patchEvalTask`	Evaluator and task	Patch eval task.
`patchEvalTaskWithEvalHub`	Evaluator and task	Patch eval task with eval hub.
`patchIntegrationKey`	Data import	Patch integration key.
`patchMonitor`	Monitor	Patch monitor.
`patchPerformanceMonitor`	Monitor	Patch performance monitor.
`patchPromptOptimizationTask`	Evaluator and task	Patch prompt optimization task.
`pauseFileImportJob`	Data import	Pause an existing job that has been imported from a blob store
`pauseTableImportJob`	Data import	Pause an existing job that has been imported from a table
`removePromptVersionLabel`	Prompt	Remove a label from a prompt version
`removeSpaceMember`	Admin	Remove a user from a space
`removeTagsFromDataset`	Dataset and annotation	Remove tags from dataset.
`removeTagsFromExperiment`	Dataset and annotation	Remove tags from experiment.
`removeTagsFromModel`	Project and model	Remove tags from model.
`resetFileStatus`	Data import	Reset the status of a file
`resetSignalAgentConfig`	Managed agent and Signal	Revert a project’s Signal automation back to the shared built-in agent config, detaching any custom config (the custom config itself is left intact).
`revokeApiKey`	Admin	Revokes an API key
`runExperimentTask`	Evaluator and task	Run an experiment task with configurable LLM interactions
`runOnlineTask`	Evaluator and task	Run an online task
`sendSandboxMessage`	Managed agent and Signal	Send a follow-up message to a running sandbox agent
`setAutomationEnabled`	Managed agent and Signal	Pause or resume a managed agent automation.
`setAutomationRepo`	Managed agent and Signal	Set or clear an automation’s repo binding — the repo its spawned jobs and ‘Open PR’ / ‘Open GitHub issue’ actions target.
`setModelAutoBaselineConfig`	Project and model	Set model auto baseline config.
`setModelBaseline`	Project and model	Sets the primary baseline for a model
`setSignalAgentConfig`	Managed agent and Signal	Attach a custom agent config (sandbox config) to a project’s Signal automation, repointing it away from the shared built-in default.
`setSignalEnabled`	Managed agent and Signal	Enable or disable the Signal automation for a project.
`setSignalEnabledBulk`	Managed agent and Signal	Enable or disable the Signal automation for multiple projects in one call.
`setSignalIssueStatus`	Managed agent and Signal	Set the lifecycle status of a Signal issue — Resolve, Ignore, or re-open it.
`setSpaceGateLimit`	Admin	Set a rate limit gate value for a space.
`startFileImportJob`	Data import	Start an existing job that has been imported from a blob store
`startTableImportJob`	Data import	Start an existing job that has been imported from a table
`testIntegrationKey`	Data import	Test integration key.
`triggerAutomationNow`	Managed agent and Signal	Spawn a job for an automation immediately, bypassing next_fire_at.
`triggerMonitor`	Monitor	Manually trigger a monitor
`updateAnnotations`	Dataset and annotation	Update the annotations of a dataset
`updateAutomation`	Managed agent and Signal	Replace an existing automation’s trigger (cron cadence or metric config) in full and set or clear its per-automation agent-runtime override, in a single save.
`updateBarChartWidget`	Dashboard	Update bar chart widget.
`updateByobConnector`	Data import	Update a byob connector
`updateByobSyncedDatasource`	Data import	Update a byob synced datasource
`updateCostConfig`	Project and model	Update a cost config
`updateCustomLlmEndpoint`	LLM integration	Update custom llm endpoint.
`updateCustomMetric`	Project and model	Updates an existing custom metric.
`updateDashboardName`	Dashboard	Update dashboard name.
`updateDashboardStatus`	Dashboard	Update dashboard status.
`updateDatasetVersionExamples`	Dataset and annotation	Update the examples of a dataset version
`updateDimensionConfig`	Project and model	Updates an existing dimension config or creates a new one.
`updateExperimentChartWidget`	Dashboard	Update experiment chart widget.
`updateExternalLlmApiKey`	LLM integration	Update external llm api key.
`updateFileImportJob`	Data import	Update an existing job that has been imported from a blob store
`updateGoogleCloudIntegration`	LLM integration	Update google cloud integration.
`updateLineChartWidget`	Dashboard	Update line chart widget.
`updateLlmIntegration`	LLM integration	Update llm integration.
`updateModelColumnMappingConfig`	Project and model	Update column mapping configuration for a model
`updatePivotTableWidget`	Dashboard	Update a single pivot table widget
`updateProjectSourceMappingConfig`	Project and model	Update source mapping configuration for a project.
`updatePromptVersionLabel`	Prompt	update prompt version label.
`updateSAMLIdP`	Admin	Update an existing SAML Identity Provider configuration
`updateSandboxConfig`	Managed agent and Signal	Update sandbox config.
`updateSandboxIntegration`	Managed agent and Signal	Update sandbox integration.
`updateSignalConfig`	Managed agent and Signal	Update a project’s Signal config: the run cadence and the free-form additional context injected into the Signal prompt.
`updateSpace`	Admin	Update a space within an organization
`updateStatisticWidget`	Dashboard	Update a single widget
`updateTableImportJob`	Data import	Update an existing job that has been imported from a table
`updateTableIngestionParameters`	Data import	Update an existing job that has been imported from a table
`updateTextWidget`	Dashboard	Update a single widget
`updateTraceFilter`	Project and model	Updates a trace filter
`validateByobConnector`	Data import	Validate a byob connector

Skills

MCP server

API reference

API clients

All mutations

​All mutations

All mutations