CEcekura
test_framework

Get metric improvement progress

Changed on

Poll the progress of metric optimization from feedback processing. Returns the improved metric description and evaluation trigger when complete.

get/test_framework/metric-reviews/process_feedbacks_progress/

Request

  • Base URL
    https://api.cekura.ai
  • URL
    https://api.cekura.ai/test_framework/metric-reviews/process_feedbacks_progress/
  • Auth
    • API key in header X-CEKURA-API-KEY
    • or HTTP bearer
    • or HTTP bearer

Query parameters

progress_idstring required

Progress ID returned from the process_feedbacks endpoint

agent_idinteger

Agent ID for permission validation

project_idinteger

Project ID for permission validation

Response

improved_metric_descriptionstring required

Improved metric description

improved_evaluation_triggerstring required

Improved evaluation trigger. Interpretation depends on improved_trigger_kind: 'always' (literal) → run on every example; Python source → trigger.py from the sandbox (when improved_trigger_kind='custom_code'); LLM-judge prompt otherwise.

improved_trigger_kind'always' | 'llm_judge' | 'custom_code'

Tells the frontend how to interpret improved_evaluation_trigger. Set to 'custom_code' when meta-harness produced an optimized Python trigger; 'always' when no trigger gating is needed.

  • always - Always
  • llm_judge - LLM Judge
  • custom_code - Custom Code
trigger_type'llm_judge' | 'custom_code'

Type of evaluation trigger (llm_judge or custom_code)

  • llm_judge - LLM Judge
  • custom_code - Custom Code
metric_description_programunknown
evaluation_trigger_programunknown
custom_codestring

Optimized Python code (meta-harness output). When present, metric should switch to custom_code type.

type'basic' | 'custom_prompt' | 'custom_code' | 'llm_judge'

Suggested metric type after optimization (custom_code if meta-harness produced code)

  • basic - Basic (Deprecated in favor of LLM Judge)
  • custom_prompt - Custom Prompt ( Deprecated in favor of LLM Judge)
  • custom_code - Custom Code
  • llm_judge - LLM Judge
optimization_summarystring

Plain-language summary of what the optimized metric does, shown in the review dialog so the user can check intent without reading the code.

old_scoreunknown
new_scoreunknown
estimated_cost_per_sampleunknown

Changes