CEcekura
test_framework

Run metric reviews

Changed on

Run metric reviews

post/test_framework/v2/metrics/{id}/run_reviews/

Request

  • Base URL
    https://api.cekura.ai
  • URL
    https://api.cekura.ai/test_framework/v2/metrics/{id}/run_reviews/
  • Auth
    • API key in header X-CEKURA-API-KEY
    • or HTTP bearer
    • or HTTP bearer
    • or HTTP bearer

Path parameters

idinteger required

A unique integer value identifying this metric.

Request body

llm_provider'openai' | 'gemini' | 'dspy-gepa-gemini-flash' | 'deepseek-v4-flash'

Override the judge provider while running unsaved Labs changes

  • openai - OpenAI
  • gemini - Gemini
  • dspy-gepa-gemini-flash - Dspy Gepa Gemini Flash
  • deepseek-v4-flash - DeepSeek V4 Flash
evaluation_triggerstring

Override evaluation trigger setting

evaluation_trigger_promptstring

Override evaluation trigger prompt

trigger_type'llm_judge' | 'custom_code'

Override evaluation trigger implementation

  • llm_judge - LLM Judge
  • custom_code - Custom Code
evaluation_trigger_custom_codestring

Override custom-code evaluation trigger

descriptionstring

Override metric description

type'basic' | 'custom_prompt' | 'custom_code' | 'llm_judge'

Override metric type

  • basic - Basic (Deprecated in favor of LLM Judge)
  • custom_prompt - Custom Prompt ( Deprecated in favor of LLM Judge)
  • custom_code - Custom Code
  • llm_judge - LLM Judge
custom_codestring

Override custom code

promptstring

Override evaluation prompt

metric_description_programunknown
metric_description_variablesunknown
evaluation_trigger_programunknown
evaluation_trigger_variablesunknown
skip_saveboolean

If true, don't save evaluation results to database (used for internal previews)

Response

Returns progress_id for tracking progress

Changes