simulate

Change one eval of this environment. Never grades anything; grade a run again afterwards to refresh its scores.

patch/simulate/api/harness-environments/{id}/evaluations/{eval_config_id}/

Request

  • Base URL: http://localhost:8000
  • URL: http://localhost:8000/simulate/api/harness-environments/{id}/evaluations/{eval_config_id}/
  • Auth: one of:
    • API key in header X-Api-Key
    • API key in header X-Secret-Key

Request body

configobject nullable

Updated evaluation configuration parameters.

mappingobject nullable

Updated field mapping between test data and evaluation inputs.

modelstring nullable

Model to use for evaluations.

error_localizerboolean

Enable granular error localization in evaluation results.

kb_idstring uuid nullable

UUID of a knowledge base to use for grounding. Pass null to clear. Switching template_id without providing an explicit kb_id will clear the KB association.

namestring

Updated name for the evaluation configuration.

Response

OK

idstring uuid
namestring nullable
configobject nullable
mappingobject nullable
error_localizerboolean
modelstring nullable
statusstring nullable
eval_groupstring nullable
template_idstring uuid nullable
eval_typestring
regradableboolean
editableboolean

Changes

No recorded changes to this operation across all 1 revision of this API.