Prompts

✨ Re-evaluate specific tasks from a previous run

Create a new inference run targeting only specific tasks (re-evaluation).

Supports four modes:

  • custom: provide explicit task_ids
  • failed: re-run tasks with failed predictions from a source run
  • incorrect: re-run tasks with score < 1.0 from a source run
  • regressions: re-run tasks that regressed between two runs
post/api/inference-runs/re-evaluate/

Request

  • Base URL
    http://localhost:8000
  • URL
    http://localhost:8000/api/inference-runs/re-evaluate/
  • Auth
    API key in header Authorization

Request body

mode'failed' | 'incorrect' | 'regressions' | 'custom' required
  • failed - failed
  • incorrect - incorrect
  • regressions - regressions
  • custom - custom
model_version_idinteger required
run_b_idinteger
source_model_run_idinteger
task_idsinteger[]

Response

mode'failed' | 'incorrect' | 'regressions' | 'custom' required
  • failed - failed
  • incorrect - incorrect
  • regressions - regressions
  • custom - custom
model_version_idinteger required
run_b_idinteger
source_model_run_idinteger
task_idsinteger[]

Changes

No operation changes recorded.