RL

Summarize an RL run's scored tasks and before-and-after comparison

Changed on

Counts every reported attempt once, as its latest report, per phase, and compares baseline with evaluation the way the console's run page does. comparable is false when the phases scored different numbers of attempts or different tasks. measurable is false when the phases are not comparable or every attempt passed or failed in both. When dropped_events is above zero or truncated is true, reason is incomplete_events and neither is true, because missing events could change either score. resolution_pp is the smallest change the task count can show. Figures come from events the workload reported and do not establish general model improvement.

get/v1/workloads/{id}/rl-summary

Request

  • Base URL
    / (relative, and the document was published on a file host, not at the API’s origin)
  • Auth
    HTTP bearer

Path parameters

idstring required

Response

Success

schema_versioninteger required
workload_idstring required
dropped_eventsinteger required
truncatedboolean required

Changes