Sign in
evaluators

Get evaluator

Retrieve a single evaluator by its ID.

get/v1/platform/evaluators/{evaluator_id}

Path parameters

evaluator_idstring required

Evaluator ID

Response

OK

created_atstring
created_bystring
feedback_keysstring[]
idstring
namestring
spend_usdnumber

Sum of LLM-as-judge run rule spend for the requested period (omitted when feature is disabled).

tenant_idstring
type'llm' | 'code'
updated_atstring

Changes

Changed in 3 of the 48 revisions of this API.7

  • a0acb3a6a1011See the full diff
    • ○

      added the optional property spend_usd to the response with the 200 status

      response-optional-property-added

    This revision also has 6 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • e0b1677609475See the full diff
    • ○

      added the optional property llm_evaluator/allOf[evaluators.LLMEvaluator]/num_few_shot_examples to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property llm_evaluator/allOf[evaluators.LLMEvaluator]/use_corrections_dataset to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property run_rules/items/corrections_dataset_id to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property run_rules/items/num_few_shot_examples to the response with the 200 status

      response-optional-property-added

    • ○

      added the optional property run_rules/items/use_corrections_dataset to the response with the 200 status

      response-optional-property-added

  • e86be67718ee1See the full diff
    • ○

      endpoint added

      endpoint-added