Sign in
Automation rule evaluators

Update Automation Rule Evaluator by id

Update Automation Rule Evaluator by id

patch/v1/private/automations/evaluators/{id}

Path parameters

idstring uuid required

Request body

namestring required
sampling_ratenumber float

Fraction of production (SDK-logged) items this rule scores, from 0 to 1. Trace rules ignore this value for experiment, playground and optimization traces and score them in full; span and thread rules only ever evaluate SDK-logged data.

enabledboolean
trigger_scope'production' | 'experiment' | 'both'
project_idstring uuid

Primary project ID (legacy field, maintained for backwards compatibility)

project_idsstring[]

Multiple project IDs (new field for multi-project support)

type'llm_as_judge' | 'user_defined_metric_python' | 'trace_thread_llm_as_judge' | 'trace_thread_user_defined_metric_python' | 'span_llm_as_judge' | 'span_user_defined_metric_python'
action'evaluator' | 'annotation_queue_router' required

Response

No content

Changes

Changed in 4 of the 67 revisions of this API.53

  • 4baa2ed0236f1See the full diff
    • ○

      added the new annotation_queue_router enum value to the request property

      request-property-enum-value-added

  • 0739fa5022ca4See the full diff
    • ●

      the request property's exclusiveMaximum was set to false

      request-property-exclusive-max-set

    • ●

      the request property's exclusiveMinimum was set to false

      request-property-exclusive-min-set

    • ●

      the request property's max was set to 1.00

      request-property-max-set

    • ●

      the request property's min was set to 0.00

      request-property-min-set

  • 0bfce600211c11See the full diff
    • ●

      the request property's maxLength was set to 150

      request-property-max-length-set

    • ○

      the request property's minLength was decreased from 1 to 0

      request-property-min-length-decreased

  • 2ad1c641e6571See the full diff
    • ○

      added the new optional request property

      new-optional-request-property