Automation rule evaluators

Update Automation Rule Evaluator by id

Changed on

Update Automation Rule Evaluator by id

patch/v1/private/automations/evaluators/{id}

Request

  • Base URL
    http://localhost:5173/api
  • URL
    http://localhost:5173/api/v1/private/automations/evaluators/{id}
  • Auth
    none declared

Path parameters

idstring uuid required

Request body

namestring required
sampling_ratenumber float

Fraction of production (SDK-logged) items this rule scores, from 0 to 1. Trace rules ignore this value for experiment, playground and optimization traces and score them in full; span and thread rules only ever evaluate SDK-logged data.

enabledboolean
trigger_scope'production' | 'experiment' | 'both'
project_idstring uuid

Primary project ID (legacy field, maintained for backwards compatibility)

project_idsstring[]

Multiple project IDs (new field for multi-project support)

type'llm_as_judge' | 'user_defined_metric_python' | 'trace_thread_llm_as_judge' | 'trace_thread_user_defined_metric_python' | 'span_llm_as_judge' | 'span_user_defined_metric_python'
action'evaluator' | 'annotation_queue_router' required

Response

No content

Changes

  • 4baa2ed0236fRevision changes
    • info

      added the new annotation_queue_router enum value to the request property

  • 0739fa5022caRevision changes
    • warning

      the request property's exclusiveMaximum was set to false

    • warning

      the request property's exclusiveMinimum was set to false

    • warning

      the request property's max was set to 1.00

    • warning

      the request property's min was set to 0.00