Sign in
evaluators

Create evaluator

Create a new LLM or code evaluator for the current workspace.

post/v1/platform/evaluators

Request body

namestring
type'llm' | 'code'

Response

Created

Changes

Changed in 3 of the 48 revisions of this API.7

  • a0acb3a6a1011See the full diff
    • ○

      added the optional property evaluator/spend_usd to the response with the 201 status

      response-optional-property-added

    This revision also has 6 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • e0b1677609475See the full diff
    • ○

      added the optional property evaluator/llm_evaluator/allOf[evaluators.LLMEvaluator]/num_few_shot_examples to the response with the 201 status

      response-optional-property-added

    • ○

      added the optional property evaluator/llm_evaluator/allOf[evaluators.LLMEvaluator]/use_corrections_dataset to the response with the 201 status

      response-optional-property-added

    • ○

      added the optional property evaluator/run_rules/items/corrections_dataset_id to the response with the 201 status

      response-optional-property-added

    • ○

      added the optional property evaluator/run_rules/items/num_few_shot_examples to the response with the 201 status

      response-optional-property-added

    • ○

      added the optional property evaluator/run_rules/items/use_corrections_dataset to the response with the 201 status

      response-optional-property-added

  • e86be67718ee1See the full diff
    • ○

      endpoint added

      endpoint-added