access_policies5

ace1

agents10

alert_rules5

annotation_queues2

annotation-queues21

api-key6

audit-logs1

auth7

aws_marketplace1

backfills1

beacon1

bulk-exports11

charts23

comments6

commits3

data_planes2

datasets35

directories3

evaluators6

examples15

experiment-view-overrides5

experiments1

features5

feedback15

feedback-configs4

fleet1

fleet auth11

fleet credentials1

fleet github-app11

fleet integrations6

fleet mcp18

fleet threads10

fleet trigger-templates2

fleet triggers5

fleet usage4

fleet_webhooks1

gateway-policies5

health1

hub_environments4

info2

integrations2

internal1

issues3

issues-agent5

likes1

mcp4

mcp_vendors9

me5

metrics1

model-price-map4

nps1

oauth8

optimization-jobs9

Organizations1

orgs51

ownerships3

playground-settings5

prompt-webhooks6

prompts2

public20

repos9

run27

runs7

sandboxes17

sandboxes-internal1

SCIM Tokens5

service-accounts3

sessions1

settings2

skills5

tag-transitions1

tags5

tenant2

threads3

tools8

tracer-sessions26

TTL Settings2

ttl-settings2

usage-limits4

workspaces38

run

Create Rule

Create a new run rule.

post/api/v1/runs/rules

Request body

display_namestring required

session_idstring uuid nullable

is_enabledboolean

dataset_idstring uuid nullable

sampling_ratenumber required

filterstring nullable

trace_filterstring nullable

tree_filterstring nullable

backfill_fromstring date-time nullable

use_corrections_datasetboolean

num_few_shot_examplesinteger nullable

extend_onlyboolean

transientboolean

add_to_annotation_queue_idstring uuid nullable

add_to_dataset_idstring uuid nullable

add_to_dataset_prefer_correctionboolean

evaluator_idstring uuid nullable

evaluator_versioninteger nullable

create_alignment_queueboolean

include_extended_statsboolean

group_by'thread_id' nullable

tracer_session_issue_idstring uuid nullable

Response

Successful Response

idstring uuid required

tenant_idstring uuid required

is_enabledboolean

session_idstring uuid nullable

session_namestring nullable

dataset_idstring uuid nullable

dataset_namestring nullable

display_namestring required

sampling_ratenumber required

filterstring nullable

trace_filterstring nullable

tree_filterstring nullable

add_to_annotation_queue_idstring uuid nullable

add_to_annotation_queue_namestring nullable

add_to_dataset_idstring uuid nullable

add_to_dataset_namestring nullable

add_to_dataset_prefer_correctionboolean

corrections_dataset_idstring uuid nullable

use_corrections_datasetboolean

num_few_shot_examplesinteger nullable

extend_onlyboolean

include_extended_statsboolean

created_atstring date-time required

updated_atstring date-time required

backfill_fromstring date-time nullable

backfill_idstring uuid nullable

backfill_statusstring nullable

backfill_progressnumber nullable

backfill_errorstring nullable

backfill_completed_atstring date-time nullable

transientboolean

evaluator_versioninteger required

evaluator_idstring uuid nullable

alignment_annotation_queue_idstring uuid nullable

group_by'thread_id' nullable

Changes

Changed in 5 of the 48 revisions of this API.149

May 27, 2026a0acb3a6a10113See the full diff
- ▲
  removed RunRuleSpendLimitSchema from the spend_limit request property anyOf list
  request-property-any-of-removed
- ○
  added the new optional request property tracer_session_issue_id
  new-optional-request-property
- ○
  added RunRuleSpendLimitSchema-Input to the spend_limit request property anyOf list
  request-property-any-of-added
- ○
  added the optional property spend_limit to the response with the 200 status
  response-optional-property-added
This revision also has 6 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
May 1, 20260480571f80d71See the full diff
- ○
  added the new optional request property spend_limit
  new-optional-request-property
Apr 13, 2026e86be67718ee1See the full diff
- ○
  added the optional property backfill_id to the response with the 200 status
  response-optional-property-added
Mar 19, 20267bbcecd856b24See the full diff
- ●
  removed the optional property backfill_completed_at from the response with the 200 status
  response-optional-property-removed
- ●
  removed the optional property backfill_error from the response with the 200 status
  response-optional-property-removed
- ●
  removed the optional property backfill_progress from the response with the 200 status
  response-optional-property-removed
- ●
  removed the optional property backfill_status from the response with the 200 status
  response-optional-property-removed
This revision also has 25 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Mar 10, 20269ca78cc321844See the full diff
- ○
  added the optional property backfill_completed_at to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property backfill_error to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property backfill_progress to the response with the 200 status
  response-optional-property-added
- ○
  added the optional property backfill_status to the response with the 200 status
  response-optional-property-added

Full history