Automation rule evaluators

Update Automation Rule Evaluator by id

Update Automation Rule Evaluator by id

patch/v1/private/automations/evaluators/{id}

Path parameters

idstring uuid required

Request body

namestring required
sampling_ratenumber float

Fraction of production (SDK-logged) items this rule scores, from 0 to 1. Trace rules ignore this value for experiment, playground and optimization traces and score them in full; span and thread rules only ever evaluate SDK-logged data.

enabledboolean
trigger_scope'production' | 'experiment' | 'both'
project_idstring uuid

Primary project ID (legacy field, maintained for backwards compatibility)

project_idsstring[]

Multiple project IDs (new field for multi-project support)

type'llm_as_judge' | 'user_defined_metric_python' | 'trace_thread_llm_as_judge' | 'trace_thread_user_defined_metric_python' | 'span_llm_as_judge' | 'span_user_defined_metric_python'
action'evaluator' required

Response

No content

Changes

Changed in 3 of the 57 revisions of this API.52

    • the sampling_rate request property's exclusiveMaximum was set to false

      request-property-exclusive-max-set

    • the sampling_rate request property's exclusiveMinimum was set to false

      request-property-exclusive-min-set

    • the sampling_rate request property's max was set to 1.00

      request-property-max-set

    • the sampling_rate request property's min was set to 0.00

      request-property-min-set

  • 0bfce600211c11See the full diff
    • the name request property's maxLength was set to 150

      request-property-max-length-set

    • the name request property's minLength was decreased from 1 to 0

      request-property-min-length-decreased

    • added the new optional request property trigger_scope

      new-optional-request-property